Unity asset workflows for Film and Animation pipelines - Unite Copenhagen 2019
Download as PPTX, PDF•3 likes•2,608 views
This document outlines the integration of Unity into film and animation production pipelines, discussing data import and export processes using industry-standard formats such as Alembic and USD. It provides guidance on getting data into Unity, leveraging it for tasks like look development and layout, and then extracting it back out for further use. The document is intended for individuals familiar with production pipelines who are looking to optimize their workflows with Unity.
![C# Scripting
32
string usdFile = System.IO.Path.Combine(UnityEngine.Application.dataPath, "sceneFile.usda");
// Populate Values.
var value = new MyCustomData();
value.aString = "IT'S ALIIIIIIIIIIIIIVE!";
value.anArrayOfInts = new int[] { 1, 2, 3, 4 };
value.aBoundingBox = new UnityEngine.Bounds();
// Writing the value.
var scene = Scene.Create(usdFile);
scene.Time = 1.0;
scene.Write("/someValue", value);
Debug.Log(scene.Stage.GetRootLayer().ExportToString());
scene.Save();
scene.Close();
// Reading the value.
Debug.Log(usdFile);
value = new MyCustomData();
scene = Scene.Open(usdFile);
scene.Time = 1.0;
scene.Read("/someValue", value);
Debug.LogFormat("Value: string={0}, ints={1}, bbox={2}",
value.aString, value.anArrayOfInts, value.aBoundingBox);
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25](https://image.slidesharecdn.com/filmanimationpipelinesv2-191014194742/85/Unity-asset-workflows-for-Film-and-Animation-pipelines-Unite-Copenhagen-2019-30-320.jpg)
![60
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
over "column_prefab" (
prepend references = @.Unite_CPHcolumn.usda@</World>
)
{
matrix4d xformOp:transform.timeSamples = {
0: ( (1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0), (0, 0, 0, 1) ),
}
uniform token[] xformOpOrder = ["xformOp:transform"]
over "Materials"
{
}
over "column"
{
float3[] extent.timeSamples = {
0: [(-0.5727719, -1.5, -0.49923185), (0.5727719, 11.14996, 0.49945638)],
}
matrix4d xformOp:transform.timeSamples = {
0: ( (1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0), (0, 0, 12, 1) ),
}
uniform token[] xformOpOrder = ["xformOp:transform"]
}
USD Overrides](https://image.slidesharecdn.com/filmanimationpipelinesv2-191014194742/85/Unity-asset-workflows-for-Film-and-Animation-pipelines-Unite-Copenhagen-2019-58-320.jpg)
Unity asset workflows for Film and Animation pipelines - Unite Copenhagen 2019
- 2. Unity Asset Workflows for Film and Animation Pipelines Chris Redmann Unity Technologies
- 3. What should I get out of this? 3 1. How can I get data from my production pipeline into Unity? 2. What can I do with it, once it is in Unity? 3. How can I get my data back out from Unity, and into my pipeline?
- 4. Who is this talked geared for? 4 — Likely familiar with production pipelines, but new to Unity — Familiar with Unity, but new to using Film workflows — Interested in learning about how to leverage Unity in your production pipeline
- 5. Production Pipelines 6 Story Art Editorial Modeling Rigging Surfacing Layout Animation Crowds Character FX FX LightingMatte Painting Compositing
- 6. Where does Unity fit in the production pipeline? 8 — Unity is a general real-time engine — Allow ingestion of industry standard formats — Export of assets – Same format – Other methods for consumption in the pipeline
- 7. What are the industry standard formats? 9
- 8. What are the industry standard formats? 10
- 9. Requirements 11 — Unity 2019.3.0b4 — Packages — USD (preview.1-1.0.1) — Alembic (1.0.6) — High Definition RP (7.0.1) — Unity Recorder (preview.1-2.0.3) — Unity AOV Recorder (preview.3-0.1.0)
- 10. What do we need to get started? 12
- 11. How do I get data into Unity? 13 — Cover some basic export settings — Common DCC Tools — Maya — Houdini
- 12. Starting with Alembic 14 — What is supported? — IPolyMesh — IPoints — ICamera — IFaceSet — IXform — ISubD is not – Not for transferring workflow data
- 13. Houdini Alembic Output 15 — Primitive Groups — Save Non-Empty Groups as Face Sets — Submesh output — Point Export – POP objects – SOP Points — Attributes – Point – Vertex
- 14. Maya Alembic Output 16 — Shading groups as submeshes — Enable Write Face Sets — Multiple UV sets – Enable UV Write – Enable Write UV Sets — Vertex Color – Enable Write Color Sets — Write Normals
- 15. Starting with USD 17 — What is supported? — UsdGeomMesh — UsdGeomPointInstancer — UsdGeomCamera — UsdSkel — As name implies, scene description format – More supported scene entities than Alembic – Rigs can be handled via UsdSkel – PreviewSurface – Basic Material
- 16. Houdini USD Output 18 — The Prefix will be set as the root in the Unity Prefab or GameObject — For animated sequences, use one file — Use the usdprimpath primitive attribute for GameObject naming — Attributes – st/uv – Cd – N
- 17. Maya USD Output 19 — pxrUsdExport — Export UVs — map1 — Export displayColor primvar — UsdSkel – Export Skeletons – Export Skin Clusters — Default Mesh Scheme
- 18. Now I have data from my pipeline, how do I get it into Unity? 20
- 19. Start with Alembic import 21 — Import like any other asset — Creates a Prefab — Entire Xform hierarchy recreated
- 20. Alembic caveats 22 — Copied into project — Reimport on external Asset change — No material support – Alembic Material Mapper (Film TV toolbox package) – Requires simultaneous export of FBX, but could alleviate initial asset pain
- 21. Alembic Components 23 — Alembic Stream Player — Alembic Points Cloud — Alembic Points Renderer — Alembic Exporter
- 22. The time parameter can be used to set a specific point in the cache Alembic Stream Player 24 Offsetting this adjusts the point in time, but will not drive the animation
- 24. USD Import 26 — USD Menu – Import as GameObjects – Import as Prefab – Import as Timeline Clip
- 25. USD Import 27 — UsdSkel – Quality Settings Skin Weights — Import settings – Composition arcs – UV data — USD Components — Not copied into the Project — Can also import Alembic
- 26. USD Asset - Simple 28 — Rebuilding and Refreshing — USD Root Path — Payload Policy — Materials
- 27. USD Asset - Advanced 29 — Material Options — Mesh Options – St — Generate Lightmap Uvs — Material Import Mode – Import Display Color – Import Preview Surface
- 28. USD Inspector 30 — primvars from USD — Not all are in every file
- 29. USD Inspector – Console Output 31
- 30. C# Scripting 32 string usdFile = System.IO.Path.Combine(UnityEngine.Application.dataPath, "sceneFile.usda"); // Populate Values. var value = new MyCustomData(); value.aString = "IT'S ALIIIIIIIIIIIIIVE!"; value.anArrayOfInts = new int[] { 1, 2, 3, 4 }; value.aBoundingBox = new UnityEngine.Bounds(); // Writing the value. var scene = Scene.Create(usdFile); scene.Time = 1.0; scene.Write("/someValue", value); Debug.Log(scene.Stage.GetRootLayer().ExportToString()); scene.Save(); scene.Close(); // Reading the value. Debug.Log(usdFile); value = new MyCustomData(); scene = Scene.Open(usdFile); scene.Time = 1.0; scene.Read("/someValue", value); Debug.LogFormat("Value: string={0}, ints={1}, bbox={2}", value.aString, value.anArrayOfInts, value.aBoundingBox); 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
- 31. UsdSkel 33
- 34. USD Payloads 36
- 35. USD Payloads 37
- 36. How do we play back our data? 38
- 37. After instantiating a Prefab, create a Timeline and Playable Director Alembic Timeline Workflow 39 On the newly created Timeline, drop an instantiated Prefab onto an Alembic Track
- 39. Create an Animator and an Animation Clip Alembic Unity Animation Workflow 41 Add the Current Time Property to the Animation Window
- 41. Why choose one over other? 43 — Depends on pipeline — Alembic is more straightforward, as it works like any other imported asset — USD is more flexible – Also adds additional complexity
- 42. We have our data in Unity, but what are some possible uses? 44
- 43. Look Development 45 — High Definition Render Pipeline – Physically Based – Area lights – Disney Diffuse / GGX specular – Support of DXR for ray-traced effects
- 45. Layout 47
- 46. Layout 48
- 47. Previz 49
- 48. Now, how do we get data back out? 50
- 49. Geometry export 51 — Alembic – Alembic Exporter Component — Supported Types — Static and Animated Meshes — Skinned Meshes — Particles — Cameras
- 50. Geometry export 52 — USD – Export Selected – Export Overrides – Export as USDZ – Usd Recorder Track
- 53. USD Recorder 55 — Usd Recorder Track — Usd Recorder Clip — Game Object Hierarchy
- 54. USD Recorder 56
- 55. USD Recorder 57
- 56. USD Overrides 58
- 57. USD Overrides 59
- 58. 60 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 over "column_prefab" ( prepend references = @.Unite_CPHcolumn.usda@</World> ) { matrix4d xformOp:transform.timeSamples = { 0: ( (1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0), (0, 0, 0, 1) ), } uniform token[] xformOpOrder = ["xformOp:transform"] over "Materials" { } over "column" { float3[] extent.timeSamples = { 0: [(-0.5727719, -1.5, -0.49923185), (0.5727719, 11.14996, 0.49945638)], } matrix4d xformOp:transform.timeSamples = { 0: ( (1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0), (0, 0, 12, 1) ), } uniform token[] xformOpOrder = ["xformOp:transform"] } USD Overrides
- 61. Camera export 63
- 62. Camera export 64
- 66. AOV Recorder 68
- 67. Render Images 69
- 68. Render AOVs 70
- 69. Where can you go from here? 71
- 70. Conclusion 73 — Use the tools, provide feedback! — Production pipelines can vary wildly, tools need to be extensible — GitHub – https://github.com/Unity-Technologies/usd-unity-sdk – https://github.com/unity3d-jp/AlembicForUnity