Show HN: API to acquire PBR materials from any portrait image for relighting

switchlight-api.beeble.ai

12 points

3 years ago

With SwitchLight API, you can extract surface normal map, albedo map, roughness map & remove background of any portrait image and use it in your own 3D pipeline that supports physical-based-rendering (PBR).

1. Surface Normal API: Surface Normal maps represent in which direction each pixel is pointing towards in 3D space, and without surface normal, things will look super flat and unrealistic.

2. Albedo API: Albedo map removes any shadows or highlights from the original image and represents what the subject would look like under very flat white lighting. Also known as diffuse map or base color.

3. Roughness API: Roughness map represents how rough or smooth the surface is. The darker it is, the smoother the surface is like a mirror. For example your clothes is much rougher than your skin, and will be represented brighter in the roughness map. Also known as glossiness map.

4. Background Removal: Removes the background and return PNG file with alpha channel

Below is a video of a demo app where you can relight a human portrait in realtime using SwitchLight API & ThreeJS. Here, I extracted surface normal, albedo and roughness map using SwitchLight API and and used ThreeJS's Physical Based Rendering capability. We've also attached a sample code snippet so feel free to try it out!

Demo Video: https://www.youtube.com/watch?v=JaIBwL4w7HA

Code Snippet: https://www.switchlight-api.beeble.ai/docs/tutorial