----------------- **OpenPose Unity Plugin** is a **wrapper of the [OpenPose](https://github.com/CMU-Perceptual-Computing-Lab/openpose) library for Unity users**. It provides formatted OpenPose output and some examples. [OpenPose](https://github.com/CMU-Perceptual-Computing-Lab/openpose) is a real-time multi-person system able to jointly detect human body, hand, facial, and foot keypoints (in total 135 keypoints) on single images. The OpenPose Unity Plugin project is **authored by [Tianyi Zhao](http://tianyizhao.com), [Gines Hidalgo](https://www.gineshidalgo.com/), and [Yaser Sheikh](http://www.cs.cmu.edu/~yaser/)**. Currently, it is being **maintained by [Tianyi Zhao](http://tianyizhao.com) and [Gines Hidalgo](https://www.gineshidalgo.com/)**. [**Demo/tutorial video**](https://youtu.be/Jrcak4n6PG4) of the working system.

^{Tianyi Zhao (left) and Gines Hidalgo (right) testing the OpenPose Unity Plugin}

## NOTICE This is an alpha release, everything is subject to change. The plugin will finally be available in Unity Assets store in the future. ## Contents 1. [Results](https://github.com/CMU-Perceptual-Computing-Lab/openpose_unity_plugin/raw/master/#results) 2. [Installation, Reinstallation and Uninstallation](https://github.com/CMU-Perceptual-Computing-Lab/openpose_unity_plugin/raw/master/#installation-reinstallation-and-uninstallation) 3. [Citation](https://github.com/CMU-Perceptual-Computing-Lab/openpose_unity_plugin/raw/master/#citation) 4. [License](https://github.com/CMU-Perceptual-Computing-Lab/openpose_unity_plugin/raw/master/#license) ## Results ### Body and Foot Estimation

^{Testing the OpenPose Unity Plugin for body and foot detection}

### Body, Foot, Face, and Hands Estimation

^{Testing the OpenPose Unity Plugin for body, foot, face, and hand detection}

## Installation, Reinstallation and Uninstallation Follow the steps in the installation documentation in [doc/installation.md](https://github.com/CMU-Perceptual-Computing-Lab/openpose_unity_plugin/blob/master/doc/installation.md). ## Citation Please cite these papers in your publications if it helps your research (the face keypoint detector was trained using the procedure described in [Simon et al. 2017] for hands): @inproceedings{cao2018openpose, author = {Zhe Cao and Gines Hidalgo and Tomas Simon and Shih-En Wei and Yaser Sheikh}, booktitle = {arXiv preprint arXiv:1812.08008}, title = {Open{P}ose: realtime multi-person 2{D} pose estimation using {P}art {A}ffinity {F}ields}, year = {2018} } @inproceedings{cao2017realtime, author = {Zhe Cao and Tomas Simon and Shih-En Wei and Yaser Sheikh}, booktitle = {CVPR}, title = {Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields}, year = {2017} } @inproceedings{simon2017hand, author = {Tomas Simon and Hanbyul Joo and Iain Matthews and Yaser Sheikh}, booktitle = {CVPR}, title = {Hand Keypoint Detection in Single Images using Multiview Bootstrapping}, year = {2017} } @inproceedings{wei2016cpm, author = {Shih-En Wei and Varun Ramakrishna and Takeo Kanade and Yaser Sheikh}, booktitle = {CVPR}, title = {Convolutional pose machines}, year = {2016} } Links to the papers: - [OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields](https://arxiv.org/abs/1812.08008) - [Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields](https://arxiv.org/abs/1611.08050) - [Hand Keypoint Detection in Single Images using Multiview Bootstrapping](https://arxiv.org/abs/1704.07809) - [Convolutional Pose Machines](https://arxiv.org/abs/1602.00134) ## License OpenPose Unity Plugin is freely available for free non-commercial use, and may be redistributed under these conditions. Please, see the [license](https://github.com/CMU-Perceptual-Computing-Lab/openpose_unity_plugin/raw/master/LICENSE) for further details. Interested in a commercial license? Check this [FlintBox link](https://flintbox.com/public/project/47343/). For commercial queries, use the `Directly Contact Organization` section from the [FlintBox link](https://flintbox.com/public/project/47343/) and also send a copy of that message to [Yaser Sheikh](http://www.cs.cmu.edu/~yaser/).