[well type=””]
Important Update (February 2017)
I’ve had multiple reports that the Sense for RealSense software does not work with the SR300-based Razer Stargazer. It does work with the Creative BlasterX Senz3D that I have here, but that one was originally bought as SR300 SDK so I’m not sure if it will work with the retail version of that device. I also received a message from a XYZ 3D Scanner (RealSense F200) owner that got a message that the device is not supported.
So I’m under the impression that 3D Systems has updated the software and now only supports their own Sense 2 3D Scanner (Review).
[/well]
At first the software seems to have the same consumer-focussed approach, when it welcomes you with a happy animated explainer video. But after that it’s a great looking and well functioning (Windows-only) application, but there’s a problem when using it with the XYZ 3D Scanner or Intel RealSense F200.
You might not have been at our studio, but I can tell you that the flat screen is on the left wall, not the right as pictured in the scanning preview above. And while the Sense for RealSense application has more settings than the XYZscan and RealSense SDK sample combined (screenshots of the Advanced Features below), it misses the crucial one of being able to mirror the camera feed (remember the F200 is a Front Facing 3D camera so its feed is mirrored by default), which makes it nearly impossible to scan away from yourself. The manual does mention a “Flip Scan View” option, but that’s only available with the SR300 hardware and just rotates the feed instead of mirroring it.
I did find a workaround for to flip my complete laptop screen. Read about it in the XYZ / RealSense F200 Review.
[row]
[column lg=”6″ md=”12″ sm=”12″ xs=”12″ ]
[/column]
[column lg=”6″ md=”12″ sm=”12″ xs=”12″ ]
[/column]
[/row]
If you’re curious you can check out the results of the sneaker scan above with the geometry resolution set to its lowest and highest setting, but I’ll continue with my two test subjects Teddy and Patrick for the sake of comparison. Switching between scan modes is as simple as clicking one of the three always-visible buttons:
Body scanning isn’t available with F200 hardware (that should work with the R200 and SR300) so I started with a head scan. The actual scanning procedure is visible in the first image of this section. I noticed that the software asks the you to hold still once in a while to “capture a good image” similar to the mobile apps I tested for my Structure Sensor Review. This is nice because this allows the camera to capture the best-possible key frames to generate the texture map. Unfortunately the F200’s camera isn’t very light sensitive, so in normal indoor lighting conditions (it doesn’t work outdoors) you’ll always have blurred textures (like the example of the sneaker above). The examples below are both taken with three soft-boxed studio lights, which greatly improves the texture quality.
[wp_ad_camp_5]
After capturing and waiting for some calculations, you’ll get to the screenshot below. And yes—finally—editing features!
First things first: see that texture quality. It’s the best I got with the RealSense F200 compared to other software I tested it with like the XYZ Software and RealSense SDK. And this is also scanned by attaching the scanner horizontally to the bottom right corner of my laptop screen and walking around Patrick. As you can see I accidentally forgot to scan to scan the top of Patrick’s head (that’s also hard with a complete Macbook Pro in your hands, by the way), but it’s perfect for testing the Solidify feature, that makes the scan into a watertight, or manifold, 3D mesh suitable for 3D printing. It’s completely automatic and has no settings, but it did a good job in my tests. The software tries to color the newly generated geometry in a way that blends with the rest of the texture. This works for smaller areas, but is understandably harder for larger holes.
You can Crop the result, use the Erase feature to manually remove unwanted parts or use the Trim feature pictured above to make straight cuts. Which is very handy if you want to 3D print bust scans like this. Finally the Color feature let’s you tune the brightness and contrast of the model with simple sliders, but that wasn’t necessary in this case. Here’s the result as an interactive Sketchfab (you can follow me there too!) embed:
The result above was done with the Geometry Resolution set to the lowest value, delivering a polycount of just under 100K. Increasing the Resolution can double the polycount and does add some extra details in the geometry, but also more noise in the mesh. And apparently this forces the software to prioritize geometric detail over texture quality, at least with my hardware setup.
I like the “low-poly” version better and I guess Patrick agrees.
To wrap up this review I naturally had to scan Teddy one last time. And to keep the scanner as still as possible to prevent motion blur in the textures, I mounted it on a small tripod with a tie-wrap. Below you see that the device is mounted towards me, so I didn’t have to mirror the camera feed. It also show my light setup for these scans (two 40 x 40 cm softboxes with 65 Watts, 5500 Kelvin studio lights)
And since I was now seeing myself in the background, I couldn’t resist making a selfie:
I hereby declare that #DepthSensor Selfies—I’ll call them #Sensies—are the next hype!#3Dscanning #3Dscan pic.twitter.com/bXucMm3cIx
— Nick Lievendag (@NickLievendag) July 25, 2016
At this point you probably think capturing the Teddy Bear is just a quick formality to compare the quality. But I was totally surprised that the Sense for RealSense software had a really hard time capturing it. In fact, it failed! I tried it both turntable-style like above and by walking around the object like I did with the sneaker, but the software consistently lost tracking when I rotated around the side of the bear towards its back.
To find out why this was happening, I read the PDF manual and discovered that the tracking algorithm (currently) only uses geometric data—not also the RGB color information like most modern 3D scanning software packages (including, I guess, the RealSense SDK and XYZscan software itself).
However, the manual did note that the Sense for RealSense software has a special Tracking Assist feature. Depending on the size of your object, you need to print a single or dual sheet (I printed the dual sheet version on a single large A3-sized sheet) pattern with a regular printer and turn on the feature in the Advanced Settings.
But while the Tracking Assist feature looks good on paper, it didn’t solve my problem with scanning Teddy. The software still lost tracking around the 90-degrees mark when it can only see the side of the bear. Maybe this feature does work on better RealSense hardware like the SR300, but it wan’t effective for this particular test. Luckily I was able to solve this by adding some extra geometry to the scene in the form of a few Nespresso cups.
I had to put stickers on them because the cups alone are are too glossy to be detected. But… with the cups it worked at once, without any tracking problems!
The result above is captured at the higest Geometry Resolution setting (lowest-poly version here). Compared to the result from the RealSense SDK application, it’s notable that although the polycount is the about a bit lower (218K vs. 262K) it has more geometric detail. If you set the embed above to MatCap Rendering mode, you can see a hint of the knitting pattern for the first time—and check the eyes! The texture is a bit softer, but still usable.
[wp_ad_camp_5]
And of course, because of the editing features you can easily remove parts of the scan you don’t need. I tried the Trim feature for this first, but drawing a trim line between the bear and the book resulted in the bear being deleted. According to the manual, the Trim feature removes the smallest part and the book and turntable probably have a larger volume. So I used the Crop tool to delete most of the unwanted geometry and removed the rest manually with the Erase tool. Then I used Solidify to close the holes in the legs.
What’s also great are the Export and Sharing options of Sense for RealSense that appear when you click Finish.
Hitting Save will allow you to name the model and save it to the Library of the application itself, which can be accessed by clicking the icon with the 9 squares in the top left corner. Exporting can be done in .OBJ, .STL, .PLY and .WRL format, so plenty of choice there too. You can also connect the software to your Sketchfab account and export directly to this great plaform for showcasing and sharing 3D models. I couldn’t test the Facebook option because it apparently supports only Profiles, not Pages (I only have a Facebook Page), but it does also upload the model to Sketchfab first and then posts that to your Timeline. Facebook supports interactive Sketchfab embeds by default, so I just copy & pasted the Sketchfab URL to my page manually:
https://www.facebook.com/3dscanexpert/posts/500224500184687
[well type=””]
Update: I’ve had multiple reports that the Sense for RealSense software does not work with the SR300-based Razer Stargazer. It does work with the Creative BlasterX Senz3D that I have here, but that one was originally bought as SR300 SDK so I’m not sure if it will work with the retail version of that device.
[/well]
Hi Nick!
I’ve just received a brand new razer stargazer and wanted to Hi Nick!
I’ve just received a brand new razer stargazer camera and I wanted to test it with the sense for realsense software.
I installed it and launched… and bad surprise: the sw asks me for the device activation code!
It seems that the release 3.0.186 allows the only use of 3dsystems devices… am I wrong?
Am I doing anything wrong??
many thanks in advance,
Paolo
Interesting.
I was able to register my RealSense SR300 SDK (ordered from Intel, but it’s technically a Creative Senz3D) through the 3D Systems website. So I figured that could be done with any other SR300-based device as well.
I just entered the serial number that was displayed in the software on this website: http://www.3dsystems.com/shop/sense/activate and it worked.
Do you get an error while trying that procedure online?
Hi Nick,
thanks for your reply.
Actually I’ve just tried again… and the result is “invalid serial number”.
no ideas about…
oops… another issue I found… the stargazer device only works under windows 10 and with very recent CPUs!!!
The Windows 10 thing is true for SR300-based devices like the Stargazer, but the processor specs are a bit overkill in my opinion. My SR300s work perfectly fine on a 2012 MacBook Pro running Windows through Boot Camp, which has a 3rd Gen Intel Core i7 Processor. It’s a Quad Core, though.
XYZ 3D scanner also works well on a kaby lake i3 intel Nuc with 8GB ram and m.2 SSD
I think that people are having issue with using F200 and R200 in Sense software because it does not install the runtime for Intel RealSense automatically. I’ve tried to find a standalone runtime but couldn’t find. In the mean time, you could try to install irSeez3D and Cappasity. One of these software install the required files but I don’t know which of them.
I think it does install the RealSense drivers automatically, but they can also be downloaded from https://software.intel.com/en-us/intel-realsense-sdk/download
I have heard no problems with the F200 and R200 and this software. The only problems I hear are with SR300 devices that are not 3D Systems Sense 2 scanners, since they require serial number activation.
The F200 and R200 don’t need serial number activation. At least not in my tests.
Hello Nick.
I’m Gerzon Cochea from Ecuador
I try to sign in Sketchfab with the 3d System Sense software, but it does not open, I can not share the scan I made, only the first one was able to later, I do not want to start the session anymore.
I have a Sense RS Class 1
What I can do?
Thank you Nick! Your reviews made me take advantage of the sr300 sdk sale Intel is doing right now.
I can say that the discontinued SDK is not too bad for 3D scans. However, the Sense software works.
It took me a while, because several things went wrong, but I am going to recap in order for others to save some time.
First, drivers are completely installed by W10. And the drivers from Intel don’t work, because the setup cannot upgrade the SR300 firmware (??). You have to use device manager, find the SR300 Depth Camera (the SR300 Camera, instead, is already installed and working) and let W10 look for a driver. Then the old SDK works.
Sense software is strange. The 3.0.186 that you can find on Sense for RealSense page requires an activation code. It activates, but doesn’t work. So I tried the latest Sense version. Surprise, it generates a serial slightly different, so you have to activate again. However, that version works.
From device manager I disabled the creative device, leaving only the SR300, but I don’t know whether this has any kind of real effect.
Obviously it was: “First, drivers are NOT completely installed by W10. And the drivers from Intel don’t work […]”, sorry.
Hi Enrico,
exactly the same behavior: I can activate my SR300, but then comes a message that no compatible sensor was found. Unfortunately, I have no older version of Sense than 3.0.186 can you send it to me or do you know where to download ?
BTW, having an i7 notebook, but quite old (3rd gen!), I was a bit worried. Well, I can say that the combination i7 3rd gen nvidia GT635M can produce satisfactory results.
If you have Optimus, you have to use nvidia GPU to run the 3d scan software.
As a SR300 owner, I also wanted to try the ‘Sense for Realsense’ Software.
The download for Sense for Realsense has been hidden on https://www.3dsystems.com/shop/realsense/sense.
There seems to be no support for this software… the whole website of 3dsystems.com is completely confusing)
After installing on my notebook (modern win10) comes an error message: Failed to initialize Player / Details Failed to initialize Direct3D
An installation on my Desktop (modern win10) was not possible because the installation was aborted during the Installation of realsense SDK 8.0.24.
Does anybody know if this software is officially supported or how to get the Software running ?
Which is the free software available for 3D reconstruction using Real Sense D400 series? And where can I download it. Please advise 🙂
Hi
I was looking for a Sense software download and found from https://en.freedownloadmanager.org/Windows-PC/3D-Systems-Sense-FREE.html that version 2.2.0.240 is available and works.
I have not received my SR300 senor yet in the post so i cannot confirm if it works yet.
Do you think this version will require activation?
hello, I’d rather ask the second generation xyzprinting scanner (supposedly it already has an Intel SR300?) allows you to connect to a program of 3D systems (as you tried). Is it possible to activate the program directly by activating the scanner or do I only need the original scanner 3D systems?
Alternatively, you tried the intel kit itself for staging.
Thank you for the information