You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
74 lines
3.0 KiB
74 lines
3.0 KiB
2 years ago
|
# Shap-E
|
||
|
|
|
||
|
|
This is the official code and model release for Shap-E.
|
||
|
|
|
||
|
|
* See [Usage](#usage) for guidance on how to use this repository.
|
||
|
|
* See [Samples](#samples) for examples of what our text-conditional model can generate.
|
||
|
|
|
||
|
|
# Samples
|
||
|
|
|
||
|
|
Here are some highlighted samples from our text-conditional model. For random samples on selected prompts, see [samples.md](samples.md).
|
||
|
|
|
||
|
|
<table>
|
||
|
|
<tbody>
|
||
|
|
<tr>
|
||
|
|
<td align="center">
|
||
|
|
<img src="samples/a_chair_that_looks_like_an_avocado/2.gif" alt="A chair that looks like an avocado">
|
||
|
|
</td>
|
||
|
|
<td align="center">
|
||
|
|
<img src="samples/an_airplane_that_looks_like_a_banana/3.gif" alt="An airplane that looks like a banana">
|
||
|
|
</td align="center">
|
||
|
|
<td align="center">
|
||
|
|
<img src="samples/a_spaceship/0.gif" alt="A spaceship">
|
||
|
|
</td>
|
||
|
|
</tr>
|
||
|
|
<tr>
|
||
|
|
<td align="center">A chair that looks<br>like an avocado</td>
|
||
|
|
<td align="center">An airplane that looks<br>like a banana</td>
|
||
|
|
<td align="center">A spaceship</td>
|
||
|
|
</tr>
|
||
|
|
<tr>
|
||
|
|
<td align="center">
|
||
|
|
<img src="samples/a_birthday_cupcake/3.gif" alt="A birthday cupcake">
|
||
|
|
</td>
|
||
|
|
<td align="center">
|
||
|
|
<img src="samples/a_chair_that_looks_like_a_tree/2.gif" alt="A chair that looks like a tree">
|
||
|
|
</td>
|
||
|
|
<td align="center">
|
||
|
|
<img src="samples/a_green_boot/3.gif" alt="A green boot">
|
||
|
|
</td>
|
||
|
|
</tr>
|
||
|
|
<tr>
|
||
|
|
<td align="center">A birthday cupcake</td>
|
||
|
|
<td align="center">A chair that looks<br>like a tree</td>
|
||
|
|
<td align="center">A green boot</td>
|
||
|
|
</tr>
|
||
|
|
<tr>
|
||
|
|
<td align="center">
|
||
|
|
<img src="samples/a_penguin/1.gif" alt="A penguin">
|
||
|
|
</td>
|
||
|
|
<td align="center">
|
||
|
|
<img src="samples/ube_ice_cream_cone/3.gif" alt="Ube ice cream cone">
|
||
|
|
</td>
|
||
|
|
<td align="center">
|
||
|
|
<img src="samples/a_bowl_of_vegetables/2.gif" alt="A bowl of vegetables">
|
||
|
|
</td>
|
||
|
|
</tr>
|
||
|
|
<tr>
|
||
|
|
<td align="center">A penguin</td>
|
||
|
|
<td align="center">Ube ice cream cone</td>
|
||
|
|
<td align="center">A bowl of vegetables</td>
|
||
|
|
</tr>
|
||
|
|
</tbody>
|
||
|
|
<table>
|
||
|
|
|
||
|
|
# Usage
|
||
|
|
|
||
|
|
Install with `pip install -e .`.
|
||
|
|
|
||
|
|
To get started with examples, see the following notebooks:
|
||
|
|
|
||
|
|
* [sample_text_to_3d.ipynb](shap_e/examples/sample_text_to_3d.ipynb) - sample a 3D model, conditioned on a text prompt
|
||
|
|
* [sample_image_to_3d.ipynb](shap_e/examples/sample_image_to_3d.ipynb) - sample a 3D model, conditioned on an synthetic view image.
|
||
|
|
* [encode_model.ipynb](shap_e/examples/encode_model.ipynb) - loads a 3D model or a trimesh, creates a batch of multiview renders and a point cloud, encodes them into a latent, and renders it back. For this to work, install Blender version 3.3.1 or higher, and set the environment variable `BLENDER_PATH` to the path of the Blender executable.
|