A glimpse of R&D projects at FrostBit – WinterSIM project kicks off

1. FrostBit engineers testing the measuring station (Credits: FrostBit Software Lab)

The large scope and complexity of R&D projects encompassing topics such as digital solutions, smart cities, smart health, etc., are often difficult to understand from the public. Similarly, at FrostBit Software Lab, we are constantly working on multidisciplinary projects that blend game engines, XR solutions, web development, and data systems. To give some concrete examples of our daily tasks, the ongoing project of ‘MiGaEL’ aims to improve education in the mining industry through digital game-based learning, whereas the ‘VR Slaughterhouse’ project will create virtual reality training and simulation for reindeer husbandry. In one hand, FrostBit is also running the ‘Towards Sustainable Tendering’ project that will develop a web-based tool to enhance the process of tendering of acquisition that will lead to a long-term economic and environmental impact in the Lapland region.

Executing R&D projects is complex and requires comprehensive planning. How does this work in practice at the FrostBit Software Lab? When developing new tech solutions, we employ an iterative process based on researching, applying, and testing. I will try to break down the workflow by focusing on the case of the ongoing WinterSIM project: In brief, WinterSIM which is funded by Business Finland aims at turning Lapland and Snowbox testing facilities into the European ‘hub’ of winter testing and simulations for autonomous vehicles. The role of FrostBit in the WinterSIM project is to create virtual simulations for autonomous driving vehicles using game technologies such as Unreal and the open-source CARLA simulator. This will be done using sensors, LIDAR’s and cameras, which will gather real-world data, for example, snowfall and ice, to create the virtual simulation environment. The data will then be exported into the CARLA simulator and combined with urban and rural road winter conditions.

Designing the measuring station – data collection point

FrostBit engineers have designed a tailored measuring station which will be used to collect the data from the real-world simulations. The measuring station will be located at the Lapland UAS. The measuring station includes two LIDAR sensors, a depth-sensing camera, a radar, and a weather station. The measuring station will be controlled remotely supported by a wireless connection. Currently, the engineers are testing the station and preparing for real data collection. Additional measuring devices will be used for data collection in the later stages of the project.

2. The 3D visualization of the measuring station and the components (Credits: FrostBit Software Lab)

Utilizing CARLA open-source simulator

The CARLA simulator is an open-source simulator developed with Unreal Engine 4 that will be used to develop the winter layer (conditions) simulation for autonomous driving vehicles. FrostBit Software Lab will be the first one to create the winter layer for the CARLA simulator. The expected outcome is a validated virtual winter simulation in CARLA, which combines data from the measuring station, a digital twin of the Aurora Intelligent Road, and 3D surroundings of the Aurora Road.

3. Unreal 4 Engine

RoadRunner to create a virtual model of the Aurora Intelligent Road

The FrostBit engineers use real map data in RoadRunner to create a virtual model of the Aurora Intelligent Road. RoadRunner is fully compatible with Unreal Engine 4 and enables altitude model, point cloud, and aerial view. By using RoadRunner we ensure that the virtual model represents the real road as accurately as possible.

Data collection through 360 degrees video in Muonio, Lapland

Since there was not sufficient material available, the FrostBit team went to the town of Muonio, Lapland, and took 360 degrees video in order to use the material as an accurate source for 3D modeling of the surroundings of the Aurora Intelligent Road. We will use Blender (open-source) to model a virtual environment. The 360 camera was mounted on top of the car, which drove 40 km/h alongside a 10 km long road.

4. Filming the Aurora Intelligent Road in Muonio, Lapland using a 360 camera mounted on top of the car (Credits: FrostBit Software Lab)

Early-phase prototype

In the video below, you can see an early phase prototype of the working simulator. We are ready to integrate the dataset into the simulation as well as 3D models of the Aurora Intelligent Road. The aim is to create a virtual simulation environment in which the visual winter condition can be simulated according to the data. For instance, users can simulate heavy snow or very icy road conditions. The first results of the visual winter simulations are promising although the project is in the early stages.

5. A prototype version of winter condition simulations (Credits: FrostBit Software Lab)

The project is a joint collaboration between companies and universities such as Lapland Proving Ground, Ramboll Finland, Lapland University of Applied Sciences, Roadscanners, Sensible 4, Toptester, and Aurora Snowbox.

If you would like to know more about the project, you can contact Pertti Rauhala at (firstname.lastname@lapinamk.fi).

The FrostBit team working in the project include Pertti Rauhala, Tuomas Herranen, Reko Paananen, Samuli Valkama, Miko Piitsalo, Aleksi Narkilahti, Juha Petäjäjärvi and Joel Koutonen.

Teachers working in the WinterSIM project: Minna Korhonen, Tauno Tepsa and Petri Hannula.  


Written by Erson Halili | 01/12/2020

Summer Game Studies 2020

In 2020, the Summer Game Studies are held for the fourth time, but this year is exceptional in many ways. For the first time, summer game studies will be conducted entirely remotely, due to the prevailing epidemic situation.

Remote Teaching and studying have posed many new challenges, but at the same time provided an opportunity to try out new teaching methods. Teachers in the Summer Game Studies have become “YouTube stars” and all teaching materials are pre-prepared and uploaded to YouTube for students to use, allowing each student to progress individually – and if something feels difficult, they have the chance to rewind and watch the video again. Although the material is available on YouTube, students are offered individual guidance during the week: Question hours are held from Tuesday through Thursday, teachers tour in groups on Mondays and Fridays, and a Sprint Review is held every other Friday. Sprint Reviews are good opportunities to get to follow the progress and see the different stages of development of the game projects.

At the beginning of the Summer Game Studies, 16 groups of students were formed who will be working together throughout the summer. The Game Studies began with the basics of game design and grouping, from which we continued to learn both programming and modeling with the help of videos. This year, a record number of students took part in summer game studies: more than 110 students were enthusiastic. Students applied from high school, university, and university of applied sciences and each group found their areas of interest and strengths. Best of all, during the summer it is possible to try out different tasks in a group and learn something new. You don’t have to code or model all summer, but you can try different roles according to your preference.

Summer Game Roles
Producer, Game Tester, Sound Designer, Screenwriter, Field Designer, Game Designer, Gameplay Programmer, 3D Programmer, Concept Artist, Technical Artist, VFX Artist, Game Engine Programmer, Network Programmer, Programmer, 3D Artist, Animator, UI Artist, Community Manager, Data Analyzer

Currently, most student teams are spending their summer vacation week, which this year is during the Midsummer week. A week’s holiday after an initial clutch in studies is surely a warm breeze. Spring 2020 has been full of studying for most students, after which summer game studies began with full steam. Now students are allowed to enjoy the summer and take it easy.

After Midsummer, we return to continue our Summer Game studies: the next goal is to build a working prototype that will be tested at the next Sprint Review. Once again, amazing games are to be expected. Although this year’s theme is “Adventure Games”, there will be various genres of games to test at the closing ceremony on August 21st. There will be 2D and 3D games that utilize different game mechanics: so plenty of fun is to be expected! We hope that by the end of the summer we will be able to hold a joint closing ceremony and test the games of each group in the University facilities.

The Summer game studies are organized in co-operation between Lapland University of Applied Sciences and the University of Lapland. The staff of the University of Lapland and the Digital Solutions Competence Group of Lapland University of Applied Sciences work as teachers in summer game studies and are responsible for supervising students.

We will be publishing Game Trailers from the Summer Game Studies on the FrostBit website at the end of the summer – so stay tuned!


Written by Toni Westerlund & Jarkko Piippo | 15/06/2020