The social network debuted AR Studio at F8 2017 last April with the goal of accelerating augmented reality efforts across the social network.
And the social network’s camera effects are being expanded beyond its flagship mobile applications to platforms including Instagram, Messenger and Facebook Lite, with Kirkpatrick writing that this experience is launching in closed beta on Instagram and Messenger, with Facebook Lite to be added soon.
Kirkpatrick also detailed more new tools that are being added to AR Studio:
- Tracking: Movements can be followed and tied into experiences via AR Target Tracker, body tracking, hand tracking and high-fidelity face tracking.
- Patch Editor: No code whatsoever will be required for actions such as controlling audio, manipulating materials, adding interactions and creating shaders.
- Free-to-use assets: Creators can add ready-made sound files from Facebook’s free library and, soon, 3-D models via the Sketchfab partnership detailed above.
- Background segmentation: People can be separated from their backgrounds, and experiences can be created to transport people to different places.
- Location AR: AR effects can be tied to real-world locations, and predetermined experiences can be made available when users are in those locations.
- Semantic scene understanding: Creators can create experiences that are “contextually aware,” with Kirkpatrick offering the example of having heat waves rise up when a coffee cup is recognized within a scene.
- Analytics for AR effects published by Facebook pages: Page administrators will soon be able to track impressions, captures and shares.
- 3-D posts in Camera: Users will be able to take 3-D posts from News Feed and experience them in their AR worlds via Facebook Camera on their mobile devices.