Building facade from real data

   1509   2   1
User Avatar
Member
54 posts
Joined: March 2016
Offline
Looking to use Building Generator, but using real "street view" kind of data as souce.
Defining manually different buildings style is time consuming and also will never replicate all the real buildings on a street.
Using Google Street View data is not allowed for offline usage.
As middle ground I was thinking if it's possible to extract from self-produced recorded 360 videos basic info about the buildings (prevalent color, position of the windows, number of floors) and next use these abstract data to generate the buildings.
Want to ask if someone ever faced this kind of problem.
AMD Ryzen 5 2600X, 4x16GB 3200 Mhz, Kfa2 GTX 1070 EX 8GB, Windows 10 Pro, KDE Neon
User Avatar
Member
104 posts
Joined: Dec. 2014
Offline
davide445
Looking to use Building Generator, but using real "street view" kind of data as souce.
Defining manually different buildings style is time consuming and also will never replicate all the real buildings on a street.
Using Google Street View data is not allowed for offline usage.
As middle ground I was thinking if it's possible to extract from self-produced recorded 360 videos basic info about the buildings (prevalent color, position of the windows, number of floors) and next use these abstract data to generate the buildings.
Want to ask if someone ever faced this kind of problem.
If you would use a real street data, first of all, you are talking about some sort of 3D scan? Then photogrammetry is your friend. There are free/commercial solutions which Houdini supports to make a geometry out of photos.
But if you think there would be an algorithm to extract that data and magically recreate that modules based on your 360 image, technology is not there yet. We would need to train a lot of ML nodes for that to work, but I am sure there must be a paper somewhere or someone is working on it already and it will become available soon. Until then, the solutions are, hire professional 3D scanning crew and bring them in your neighborhood and then hire few more modelers to clean your geometry in a way that they remodel all the modules and texture them for the game use, for example. And this is probably too much for some indie artist pocket.
Just a note, if you plan to scan your neighborhood you better ask around if you need to acquire some permit from the local government, it is basically the same as you would shoot for the movie. So be aware of possible legal constrains as well.
User Avatar
Member
54 posts
Joined: March 2016
Offline
Drasko Ivezic
If you would use a real street data, first of all, you are talking about some sort of 3D scan? Then photogrammetry is your friend. There are free/commercial solutions which Houdini supports to make a geometry out of photos.
But if you think there would be an algorithm to extract that data and magically recreate that modules based on your 360 image, technology is not there yet. We would need to train a lot of ML nodes for that to work, but I am sure there must be a paper somewhere or someone is working on it already and it will become available soon. Until then, the solutions are, hire professional 3D scanning crew and bring them in your neighborhood and then hire few more modelers to clean your geometry in a way that they remodel all the modules and texture them for the game use, for example. And this is probably too much for some indie artist pocket.
Just a note, if you plan to scan your neighborhood you better ask around if you need to acquire some permit from the local government, it is basically the same as you would shoot for the movie. So be aware of possible legal constrains as well.
Since the area to map is quite large (many paths in 8 cities) Im working to
- if needed scanning searching just for facades pictures extraction. This will possibly be done with simple geolocation systems, but of course need time and assets. Already in contact with local privacy regulators, seems there is no real problem. Avoiding full 3D reconstruction due to needing more manual work
- if possible avoid scanning but just generate facades with the correct style. In this case looking at AI style transfer solution that can look at Street View and extract his local facade style. In this way avoiding going on the road and applicable to potentially any area where street view is available
Edited by davide445 - Dec. 16, 2020 01:41:48
AMD Ryzen 5 2600X, 4x16GB 3200 Mhz, Kfa2 GTX 1070 EX 8GB, Windows 10 Pro, KDE Neon
  • Quick Links