LeiaPix Convert is a website that combines the power of Boosting Monocular Depth (AI based 2d to 3d image converter) and depthy (a depth map editor and 3d animation maker) to produce 3d animations.
Link to website:
[ Ссылка ]
Link to videos about using Boosting Monocular Depth with google colab:
[ Ссылка ]
[ Ссылка ]
Disclaimer: I am not affiliated in any shape and form to Leia Inc. I just test stuff to make the world a better place.
I am not completely sure the website is using Boosting Monocular Depth to its full extent (which uses MiDaS v2.1 on various patches in the input image). It looks like it's using straight MiDaS v2.1 without the patching business. Usually, Boosting Monocular Depth maps look very sharp and detailed (unfortunately, the more detailed depths may be wrong, which is a problem). I personally use MiDaS v3 for all my monocular depth map needs but 2.1 is not bad at all.
In the video, I talk about extracting frames for lenticular printing. Of course, you can get the frames from the gif file but the quality is gonna be horrendous with only 256 colors. So, the only option to get the frames is via the mp4 file. Maybe there is a way to extract the frames by reading the output lightfield file (the lif file aka Leia Image File). If it's possible, let me know how.
Also, in the video, I say that I wish you could download any number of horizontal frames for lenticular printing. I don't really need it per se because I can use 3D Photo Inpainting (See my videos about it) to generate those frames. Only problem is that you can't adjust the plane of zero parallax (always the background). Anyhow, it would be nice if the website could save the depth map and have the option to load a previously saved depth map edited in a third-part software like gimp or photoshop.
In the interest of science, I compared the depth map produced by LeiaPix with one produced by MiDaS v3, BoostMonocularDepth (compphoto) using MiDaS v2.1 and BoostMonocularDepth (compphoto) using LeRes in this facebook post (it's in the comments somewhere):
[ Ссылка ]
I believe LeiaPix Convert uses MiDaS v2.1 without boosting. I mean it's using the compphoto BoostMonocularDepth code but not the actual boosting. For good reason, I think, because more often than not, the boosting makes things worse.
In the video, I mention that I don't think the depthy website still exists. That is true, depthy.me doesn't exist anymore but a clone does exist:
[ Ссылка ]
