Storytelling With Point Clouds

Roughly twice a month. Unsubscribe any time.

LIDAR is a fast and efficient method to capture high-resolution data with accurate measurements. But in this episode, the focus is not on using LIDAR to make better measurements. Rather the talk is about how point cloud data can be used to tell a story. The guest tells how creating a film with 3D LIDAR data of a city provided a medium that could be consumed by the public to understand how a city could be transformed.

About The Guest

Benjamin Müller is a team leader at Leica Geosystems in the R&D section. Doing mechatronics, they combine disciplines such as software development, mechanics, and electronics to develop devices such as drive chains for laser scanners and total stations.

Benjamin was part of a project that used LIDAR data to create a film that communicated the vision of a better city. He emphasizes the importance of using easily understandable films to communicate complex details. In his words:

“Facts do not always speak for themselves. If a visualization can be wrapped around the truth, and packaged in a story, it can reach a lot more people. And this could be a driver for change.”

How Is LIDAR Useful In 3D City Modelling?

Getting insights into a whole city is an important element in the process of transforming a city into a future-proof city. It is not possible to get this kind of insight when walking through a city because at that moment you are only viewing the city from a very small perspective.

LIDAR makes it possible to make 3D models of the whole city, with accurate measurements that preserve the integrity of the city features. Visualizing a city in this way provides a wider perspective on how various changes would impact a city. Viewing a city and its surroundings in a new perspective unlocks new ideas and better strategies of transforming a city. Additionally, LIDAR data collection can be done whenever required to capture any new changes that have happened in the city.

Drawbacks in Working with LIDAR

During LIDAR data collection, massive amounts of point clouds are captured. Even for a small city, the size of data captured can easily grow into several terabytes. With data of this size, many LIDAR experts have reported that a great part of their work, over 80%, is filtering the data. It can take months to process LIDAR data for a city.

Processing LIDAR data for a city is costly both in terms of time and money – which can run into several hundreds of thousands of dollars. Using AI in processing can considerably reduce processing times, but even then working with the data requires expensive and powerful equipment. For most people, who may just need a one-time visualization of a part of a city, it is uneconomical to buy such expensive infrastructure just to visualize a small part of the city.

How LIDAR Was Used To Visualize a Better and More Sustainable City

A project undertaken in the city of St Gallen in Switzerland used LIDAR data to create 3D models of the city. It added contributions from different experts to create subsequent versions of how the city can be transformed. These versions were pieced together to create a 30-minute long film that helped to communicate to people a vision of a greener, more sustainable city.

The advantage of using a film as a communication tool is that it is easier to understand. It effectively communicates the message to people who may not deliberately read detailed books on how to transform a city. Additionally, a film can efficiently reach a wider audience in society and inspire people to become a part of the change for a better future city.

From A Vision to A Strategy

The film of the city was created to communicate a vision of a better future city. But it also transformed into a strategizing tool. With this visualization, decision-makers could formulate a step-by-step strategy that can be applied to make the city more sustainable and healthy for both the people and the whole environment. This led to the creation of 16 books alongside the film, which contained detailed information on how to do the desired transformations in the city.

Other Uses of 3D City Models

Various sectors including tourism can benefit from 3D models of a city. Using augmented reality the 3D models can be used to support digital tourism. While visiting a site, tourists can also view the site from different perspectives, and experience things that would otherwise not be obviously visible.

For cities where you need to report the changes you are doing to structures on your property to city authorities, visualizing the changes in a 3D model provides an opportunity for understanding the impact of the changes to the city and the environment.

How Can We Democratize 3D City Data?

With AI it is possible to build services that process LIDAR data on the cloud. These services can then be accessed through a browser by the public. In this way, more people can visualize the data without having to buy very expensive infrastructure or become an expert in visualization. Providing easier and cheaper ways for the public to consume LIDAR data is an important step in its democratization. But if only a few specialists are able to use the data, it will still remain a very expensive luxury to have it.

HxDR (Hexagon Digital Reality)

HxDR is one example of a publicly available platform for viewing 3D models of cities. You have to register first before you can view detailed 3D city models. At the moment, there are models of several cities in Europe and the US on the platform. Some of the cities have high-precision geospatial data and you can also purchase parts of the city that you are interested in.

A platform like this is only the beginning of a transformation to have access to 3D data, but we expect there is more coming in the future.

More technical episodes about point clouds


In Conversation

Mechatronics and a Film Project

Daniel: Benjamin, welcome to the podcast. You’re a team leader in R&D at Leica Geosystems, working with mechatronics — but today we’re talking about making a film. Would you introduce yourself?

Benjamin: I’m Benjamin Müller, and I work as a team leader at Leica Geosystems in the R&D section. We do mechatronics — combining software, mechanics, and electronics to make our devices move, developing drive chains for laser scanners and total stations, motorization, angle systems, bearing systems. This was a bit of a coincidence: a friend connected me to a project that was asking whether we had a 3D model of the city, because they wanted to visualize how the city could be transformed into a more sustainable, future-proof city.

Daniel: Which city?

Benjamin: This is the city of St Gallen, close to Lake Constance — close to Austria and Germany, but in the Swiss part. It’s also very close to Heerbrugg, where Leica Geosystems is located. I live in the city, so for me it was interesting not just from the Leica and professional side, but also as a citizen to be part of a transformation to a greener, future-proof city.

Why LiDAR for a Film

Daniel: Why do we need LiDAR data to make a film?

Benjamin: To transform a city into a future-proof city, you need the big picture. If you walk through the city, you only see a very small perspective. 3D data lets you zoom out and see the city as a whole, and start changing it from a completely different perspective. We weren’t making measurements — the purpose was visualization.

Daniel: Why not just use something like Google Earth?

Benjamin: If you do a fly-through on Google and dive into the city, you’ll notice it’s not beautiful. With highly accurate data, the walls of houses are not tilted — they are really as they are. We also wanted the point cloud, because the project leader felt it was important. For example, we wanted to change the city into a green city, so trees are really important — and trees in a point cloud look much more real than in Google, where they look a bit like balloons. A real tree is more transparent: you have the leaves, and you can see through the tree. We used the Leica CityMapper-2, which combines LiDAR and imaging at the same time, so we got a really nice colorized point cloud.

Capturing and Processing the Data

Daniel: How long did it take to collect the data?

Benjamin: From the point we said we want the data until I had it on my computer was close to one year — but collecting the data took one day, an eight-hour flight. In between there was a lot of post-processing, ordering, and discussion about borders, regions, and accuracy. The biggest challenge for me was the crazy amount of data — something like two terabytes of point cloud. I struggled at the beginning just to load it; you need a big enough hard drive and enough RAM. I can confirm that 80 to 90% of the work is filtering the data. The model was so big that I had to focus on resolution — low resolution for points far at the horizon, high resolution at the points I wanted to make beautiful.

Daniel: How did you make it look realistic?

Benjamin: The final model was a hybrid model. All the houses were modelled as 3D objects with planes, the ground was a mesh, and the trees and other objects were a point cloud. So a house looks like a solid object and a tree looks like a transparent, real tree.

From Vision to Strategy

Daniel: What were the next steps?

Benjamin: I worked out a plan for the film with the project management, graphic designers, stakeholders, and people from the government. I was only involved in visualizing how the city could change in 3D — others decided what to change: plant trees, create parks, encounter zones, recovery zones, biodiversity zones, reduce dust exposure from traffic. Out of this vision we realized it was more than a vision — it was a concept, even a strategy that could be applied step by step. The film was sliced into chapters so you can start applying low-hanging fruits immediately and plan bigger steps for 10 or 15 years. Alongside the 30-minute film, we created 16 books with detailed information on how to do the transformation.

Daniel: Did the model lead to different decisions?

Benjamin: Definitely. If you change the perspective, it changes your imagination of how you can act in a city and how you can transform it. A lot of experts were involved, and they got a perspective they never had before — and the impact on the strategies they applied was quite big.

Communicating With a Film

Daniel: What was the aim of the film?

Benjamin: The main goal was a visualization for the citizens — maybe they don’t want to read all 16 books with the details. The film visualizes what the result could be, creating a vision so people can imagine what it means. It’s not only about putting some trees in the city; it’s an overall concept. People can dive into the city and see, “this is the city I want to live in in the future, I’m voting for this, I want to be part of this.” It’s like putting a seed into the soil and growing this imagination of a future city.

Daniel: How did people react to it?

Benjamin: In general, people really liked it — they said “yes, I want to have this.” It became noticed even outside St Gallen: cities like Geneva said “you did a very nice strategy, how can we do something like this?” City governments started to use the film and books as a blueprint for creating their own future strategy.

Other Uses of 3D City Models

Daniel: Are people looking at this model as infrastructure they can do other things with?

Benjamin: Everybody I show this film to answers with a different point of view and starts to create projects. One person said, “this is amazing, we want this data to visualize a digitalization of the city” — a digital city you can walk through, for digital tourism or augmented reality. We have a beautiful cathedral; you can visit it physically, but you could also view it from different perspectives in 3D. I believe that in the future, beautiful 3D data of your city will be a crucial part of the infrastructure of the city — including governmental processes. Right now in Switzerland, if you want to change something in your house you do it on paper, in 2D. I hope in the future you can do everything on a platform in 3D, and really see the impact of a change to the environment.

Democratizing 3D City Data

Daniel: If you had to sell this idea to other cities, how would you do it?

Benjamin: Convincing people needs a good foundation — the tools and processes behind it. As I said, 80 or 90% was cleaning up the point cloud, and nobody wants to do that every year. We need AI doing it for us, or a service from the government that many people can consume. And nobody wants to buy a supercomputer just to visualize something — so data like this should be consumed in an easy way, through a cloud application, so you don’t need an extremely powerful computer. Data needs to be more democratized so everybody can access it. As soon as you can share the data and a lot of people start using it, it becomes cheaper for everybody — if only some specialists can use it, it remains a very expensive luxury.

Daniel: If you had to start this project again, what would you do differently?

Benjamin: I would do it completely differently. I would not do it on my laptop, which was really at the end of its capability. I would do all the manipulation and fly-throughs on the platform from Hexagon — HxDR, Hexagon Digital Reality. It looks a little like Google Earth: you have the Earth, you can zoom in, and some cities have high-precision geospatial data with beautiful 3D models. If I could work there I’d have very good visualization and endless computing power through cloud scaling. Unfortunately the platform was just ramping up at the time of the project — but now I would do it like this.

About the Author
I'm Daniel O'Donohue, the voice and creator behind The MapScaping Podcast ( A podcast for the geospatial community ). With a professional background as a geospatial specialist, I've spent years harnessing the power of spatial to unravel the complexities of our world, one layer at a time.