0
1
2
3
4
5
6
7
8
9
Contact Us
1 / 9
slider-arrow
slider-arrow
slide-image
Replacing Faces in a Video Stream
1 / 9
slider-arrow
slider-arrow
slide-image

Project Details

Description

To solve the problem we considered different options for its solution. Different FaceDetection methods were used (DeepFace, Keypoint R-CNN, HRNet, Dlib, OpenPose, Dlib, OpenCV, MediaPipe and others). The main task is to find faces and anchor points on the video frame. All these methods give inaccurate results. They are designed for a video stream with a good resolution of the face. In the video, the ratio of face to resolution is very small. The result of the methods is not very good. Also considered methods using PoseDetections, and these methods failed. In the picture, you can see that without a face, the system assumes there is a face.

Features

  1. Inanimate object face replacement

Unlike human faces, animals or inanimate objects won't have the same geometric structure or landmarks. Placing a human face on them requires a dynamic approach that can adjust to various shapes and structures. Moreover, some objects or animals move unpredictably, which complicates the tracking and anchoring of the human face onto them.

 

The Onix team implemented a mapping algorithm that doesn't solely rely on traditional facial landmarks but also uses the broader contours and shape of the target entity, whether it's an animal's face or an object. Moreover, we used advanced tracking algorithms in OpenCV to keep the human face consistently placed on the moving object.

  1. Accessory augmentation

As users move or change expressions, accessories should adjust accordingly. A hat, for instance, should remain on the head, not float above it if a user raises their eyebrows. Also, different users have different face sizes and shapes. The accessories must fit proportionally, looking both too large and too small.

 

We used facial landmarks to create "anchor points" for accessories. For instance, glasses anchor to the bridge of the nose and ears, ensuring they move with the face realistically. Also, we developed an algorithm that adjusts accessory size based on detected face dimensions. For instance, the width between the eyes can determine the size of glasses.

  1. Performance efficiency

To maintain an enjoyable user experience, the solution needed to achieve real-time performance with minimal processing delay. Any noticeable lag would detract from the humor and user engagement. 

 

Our specialists utilized advanced neural network technology, namely RetinaFace, that demonstrated exceptional real-time face detection and alignment performance. It consistently detected faces within video frames in 10-20 milliseconds, regardless of variations in scale or orientation. This technology was ideal for scenarios as quick face detection and replacement were essential.

Project Crew

contribution-logo
Backend Development
Python, FastAPI, PostgreSQL, OpenC, ML, AI
contribution-logo
Frontend Development
React
Technologies
ML
AI
Python
FastAPI
PostgreSQL
React
OpenC
Machine Learning
Details
Time iconTime Spent
1360h

Similar Projects

Drone & Satellite AI for Mapping and GIS
technology iconAI
technology iconML
technology iconTensorFlow
technology iconpytorch
technology iconScikit-learn
technology icondarknet
technology iconkeras
technology iconNumpy
technology iconOpenCV
technology iconjupyter
technology iconGoogle Colab
technology iconPandas
technology iconSciPy
technology iconNLTK
technology iconMatplotlib
technology iconPillow
technology iconSeaborn
technology iconOpenVINO
technology iconMATLAB
technology iconfastai
technology iconBuilding
technology icondrone photos
technology iconobject detection
technology iconforest configuration
technology icondetect changes
technology iconsatellite imagery
technology iconMachine Learning
Hydra.Projects
technology iconPHP
technology iconLaravel
technology iconReact
technology iconNext.js
technology iconDevOps
technology iconinfrasctructure
technology iconservice
technology iconerp
technology iconmanagement
technology iconcompany management
technology iconemployees
technology iconprojects
technology iconnotifications
technology iconFormik
technology iconSails.js
PhotoWhy - Peer-to-Peer Learning App
technology iconagora
technology iconDjango
technology iconReact Native
technology iconAWS
technology iconRedis
technology iconAgora Video SDK
technology iconFirebase
technology iconStripe
technology iconNode.js
technology iconsocial networking development
technology iconE-learning
technology iconPostgreSQL
technology iconCelery
technology iconFigma
technology iconFormik
technology iconaxios
AI Chef
technology iconVue.js
technology iconAI
technology iconChat GPT
technology iconpinia
technology iconTypeScript
technology iconaxios
technology iconPUG
technology iconStrapi
technology iconchatbot
technology iconWeb
technology icondish
technology icondish generator
Cryptocurrency blog demo
technology iconReact
technology iconSolidity
technology icondapp
technology iconFinance
technology iconNext.js
technology iconMetaMask
technology iconethers
Optionblitz
technology icondesign
technology iconReact
technology iconcrypto
technology iconcryptocoins
technology iconsocial trading
technology iconprice fluctuation
technology icontrading
Learning Pool
technology iconhtml
technology iconcss
technology iconPHP
technology iconLaravel
technology iconNode.js
technology iconMySQL
technology iconMongoDB
technology iconcss3
technology iconiOS
technology iconReact
technology iconTypeScript
technology iconE-learning
technology iconExpress
technology iconDocker
technology iconReact Native
technology iconaxios
technology iconFormik
technology iconRollbar
technology iconOneSignal
technology iconPython
technology iconDjango
technology iconRedis
technology iconMemcached
technology iconPostgreSQL
Mister B&B 🏳️‍🌈
technology iconRuby
technology iconROR
technology iconiOS
technology iconAndroid
technology iconAWS
technology iconReact
technology iconHTML5
technology iconGoogle maps
technology iconMobile
technology iconSoftware QA
technology iconsocial network
technology icontravel
technology icontravel planning
technology iconObjective-C
technology iconEcommerce
technology iconbooking
technology iconStripe
technology iconaxios
technology iconCoffee Script
technology iconjQuery
technology iconLodash
technology iconBezier-easing
technology iconCard-validator
technology iconDate-fns
technology iconFile-loader
technology iconJQueryUI
technology iconJS-cookies
technology iconKinetic
technology iconMoment
technology iconMorris.js
technology iconObject-fit images
technology iconReactDatepicker
technology iconReactDropzone
technology iconReactGPT
technology iconReact Infinite Scroll
technology iconReact Lazy Load Image
technology iconReact Input Mask
technology iconReact-on-rails
technology iconReact Recaptcha
technology iconReact Redux
technology iconRedux Thunk
technology iconRedux
technology iconSwiper
technology iconReact Swipeable View
technology iconTree Multiselect
technology iconWebpack
technology iconEnlist
NowWhat
technology iconPHP
technology iconPHP Hyperf
technology iconWordPress
technology iconWeb
technology iconHealthcare
technology iconcancer
technology iconFigma
technology iconVue.js
technology iconHTML5
technology iconCSS/CSS2/CSS3
technology iconPUG
technology iconaxios
technology iconSocket.io
technology iconDay.js
Banska Stavnica Historical VR Tour
technology iconUnity
technology icon3D
technology iconE-learning
technology iconC#
technology iconBlender
technology iconSubstance Painter
technology iconPhotoshop
technology iconHoudini
technology iconAutodesk 3ds Max
technology iconAVPro
technology iconCurvedUI
technology iconAmplify Shader Editor
technology iconOpenVR
VR Medical Training
technology iconUnity
technology iconHealthcare
technology iconC#
Shell Chair
technology iconWebFlow
technology iconCSS/CSS2/CSS3
technology iconJavaScript
technology icondevelopment
technology iconanimations