Contact Us
1 / 9
Replacing Faces in a Video Stream
1 / 9

Project Details


To solve the problem we considered different options for its solution. Different FaceDetection methods were used (DeepFace, Keypoint R-CNN, HRNet, Dlib, OpenPose, Dlib, OpenCV, MediaPipe and others). The main task is to find faces and anchor points on the video frame. All these methods give inaccurate results. They are designed for a video stream with a good resolution of the face. In the video, the ratio of face to resolution is very small. The result of the methods is not very good. Also considered methods using PoseDetections, and these methods failed. In the picture, you can see that without a face, the system assumes there is a face.


  1. Inanimate object face replacement

Unlike human faces, animals or inanimate objects won't have the same geometric structure or landmarks. Placing a human face on them requires a dynamic approach that can adjust to various shapes and structures. Moreover, some objects or animals move unpredictably, which complicates the tracking and anchoring of the human face onto them.


The Onix team implemented a mapping algorithm that doesn't solely rely on traditional facial landmarks but also uses the broader contours and shape of the target entity, whether it's an animal's face or an object. Moreover, we used advanced tracking algorithms in OpenCV to keep the human face consistently placed on the moving object.

  1. Accessory augmentation

As users move or change expressions, accessories should adjust accordingly. A hat, for instance, should remain on the head, not float above it if a user raises their eyebrows. Also, different users have different face sizes and shapes. The accessories must fit proportionally, looking both too large and too small.


We used facial landmarks to create "anchor points" for accessories. For instance, glasses anchor to the bridge of the nose and ears, ensuring they move with the face realistically. Also, we developed an algorithm that adjusts accessory size based on detected face dimensions. For instance, the width between the eyes can determine the size of glasses.

  1. Performance efficiency

To maintain an enjoyable user experience, the solution needed to achieve real-time performance with minimal processing delay. Any noticeable lag would detract from the humor and user engagement. 


Our specialists utilized advanced neural network technology, namely RetinaFace, that demonstrated exceptional real-time face detection and alignment performance. It consistently detected faces within video frames in 10-20 milliseconds, regardless of variations in scale or orientation. This technology was ideal for scenarios as quick face detection and replacement were essential.

Project Crew

Backend Development
Python, FastAPI, PostgreSQL, OpenC, ML, AI
Frontend Development
Machine Learning
Time iconTime Spent

Similar Projects

Drone & Satellite AI for Mapping and GIS
technology iconAI
technology iconML
technology iconTensorFlow
technology iconpytorch
technology iconScikit-learn
technology icondarknet
technology iconkeras
technology iconNumpy
technology iconOpenCV
technology iconjupyter
technology iconGoogle Colab
technology iconPandas
technology iconSciPy
technology iconNLTK
technology iconMatplotlib
technology iconPillow
technology iconSeaborn
technology iconOpenVINO
technology iconMATLAB
technology iconfastai
technology iconBuilding
technology icondrone photos
technology iconobject detection
technology iconforest configuration
technology icondetect changes
technology iconsatellite imagery
technology iconMachine Learning
technology iconPHP
technology iconLaravel
technology iconReact
technology iconNext.js
technology iconDevOps
technology iconinfrasctructure
technology iconservice
technology iconerp
technology iconmanagement
technology iconcompany management
technology iconemployees
technology iconprojects
technology iconnotifications
technology iconFormik
technology iconSails.js
PhotoWhy - Peer-to-Peer Learning App
technology iconagora
technology iconDjango
technology iconReact Native
technology iconAWS
technology iconRedis
technology iconAgora Video SDK
technology iconFirebase
technology iconStripe
technology iconNode.js
technology iconsocial networking development
technology iconE-learning
technology iconPostgreSQL
technology iconCelery
technology iconFigma
technology iconFormik
technology iconaxios
Cryptocurrency blog demo
technology iconReact
technology iconSolidity
technology icondapp
technology iconFinance
technology iconNext.js
technology iconMetaMask
technology iconethers
technology icondesign
technology iconReact
technology iconcrypto
technology iconcryptocoins
technology iconsocial trading
technology iconprice fluctuation
technology icontrading
AI Chef
technology iconVue.js
technology iconAI
technology iconChat GPT
technology iconpinia
technology iconTypeScript
technology iconaxios
technology iconPUG
technology iconStrapi
technology iconchatbot
technology iconWeb
technology icondish
technology icondish generator
TRVLPage - mobile app for trips
technology iconReact
technology iconReact Native
technology iconmaps
technology icontraveling
technology iconNetwork
technology icontravel
TruGreat Mentorship App
technology iconReact Native
technology iconPython
technology iconStripe
technology icondeep links
technology iconTwilio API
technology iconSendbird SDK
technology iconAWS
technology iconsocial network
technology iconnotifications
technology iconchat
technology iconmentorship
technology iconaccountability
technology iconstudy
technology iconteaching
technology iconeducation
technology iconpost
technology iconcomments
technology iconsocial media app
technology iconPHP
technology iconPHP Hyperf
technology iconWordPress
technology iconWeb
technology iconHealthcare
technology iconcancer
technology iconFigma
technology iconVue.js
technology iconHTML5
technology iconCSS/CSS2/CSS3
technology iconPUG
technology iconaxios
technology iconSocket.io
technology iconDay.js
Shell Chair
technology iconWebFlow
technology iconCSS/CSS2/CSS3
technology iconJavaScript
technology icondevelopment
technology iconanimations
Banska Stavnica Historical VR Tour
technology iconUnity
technology icon3D
technology iconE-learning
technology iconC#
technology iconBlender
technology iconSubstance Painter
technology iconPhotoshop
technology iconHoudini
technology iconAutodesk 3ds Max
technology iconAVPro
technology iconCurvedUI
technology iconAmplify Shader Editor
technology iconOpenVR
technology iconVue.js
technology iconTypeScript
technology iconaxios
technology iconcookies
technology iconcss
technology iconhtml
technology iconPUG
technology iconcrypto