VKIST face capture: Multi-angle facial image data collection software for AI research and development

In the context of facial recognition technology and 3D facial modeling being increasingly widely applied in many fields such as security, healthcare , e-commerce, personal security, the need to build a structured, diverse and large-scale facial image database is becoming urgent. One of the major challenges today is how to collect image data with consistent quality, under different lighting conditions and at many shooting angles, while ensuring accuracy in data classification and storage.

To solve this problem, the research team at the Vietnam - Korea Institute of Science and Technology (VKIST) has developed VKIST face capture software, a tool that supports simultaneous control of a system consisting of multiple digital cameras and lighting modules, allowing the collection, labeling and storage of facial image data in real time.

Face image data collection and processing solution

VKIST face capture is programmed in C# language, featuring a friendly interface in Vietnamese, easy to integrate and expand.

VKIST face capture allows remote control of popular Nikon and Canon DSLR cameras such as 5DmarkII, 5DMarkIII, 6DMarkII, 1500D, 2000D, D60, D3000, D5100, D7100, D4, D800..., via USB interface and RS232 protocol. Users can perform operations such as viewing live images (Live View), adjusting technical parameters (aperture, shutter speed, ISO), commanding simultaneous photo capture, and transferring photos to the computer in real time.

In particular, the software supports simultaneous control of multiple cameras - an essential feature in multi-angle image data collection systems. The software interface is in Vietnamese, designed in separate functional blocks for ease of use and easy integration into complex systems.

The VKIST face capture software interface (Figure 1) is divided into separate blocks with functions described in Figure 2. The language displayed in the software is Vietnamese.

VKIST face capture software interface.

Diagram of the main functional blocks of the software.

VKIST face capture also integrates the ability to control the light intensity of the lighting system by transmitting data from configuration files to the light control circuit. Thanks to that, the lighting environment during the shooting process is precisely controlled, ensuring consistent image quality, which is a key factor in AI applications.

In addition, the light intensity control function is also integrated into this software. Users only need to enter the available light intensity parameter file, then use the software to read the data and transmit the parameters to the light intensity control circuit. From there, accurately control the amount of light in the surrounding environment.

Another highlight is the ability to automatically label data according to structure, making the process of managing, retrieving, and training AI models more efficient. The software supports data storage mode options (locally at the camera, saved to the computer) and data classification according to pre-defined scenarios.

Another outstanding feature is the ability to automatically label images according to a predetermined structure, which significantly saves manual classification time. VKIST face capture allows configuring how to save images: By folder, by object, by type of expression, or other variations such as wearing glasses, wearing masks, changing hairstyles...

In addition, the software also supports multiple data saving modes - including sequential recording, overwriting or saving at the camera before transferring to the server. This helps the system to be flexible in handling large amounts of images, minimizing the risk of data loss or bottlenecks during operation.

Artificial intelligence research platform and large-scale facial database construction

The software is currently being used in the facial image data collection system deployed by VKIST, which includes 33 Canon DSLR cameras, 20 adjustable lighting modules, an iron frame to place cameras and lighting around a hemisphere, and three powerful PCs with monitors and system control software. With this system, the VKIST-Nacentech Joint Laboratory/Information Technology Department, VKIST has been collecting and building a facial image database of about 500 people (about 5 million photos) and is continuing to collect more data.

*Multi-angle facial image data sample was performed by VKIST face capture software.*

The software has been used in collaborative projects with the Korea Institute of Science and Technology (KIST) to collect facial image data of more than 1,000 Vietnamese people. This database includes about 10 million photos with different facial expressions such as normal, happy, sad, scared, angry, surprised, annoyed and obscured accessories such as masks, glasses, hats, wigs under different lighting conditions.

*Software interface with full specifications.*

Data collected from the system using VKIST face capture software has been and is being applied in many directions of research and technology development:

3D face modeling from multi-angle 2D photos,

Increase the accuracy of facial recognition technology under deformed conditions (obscuration, complex lighting),

3D laser engraving of faces on glass as souvenirs,

Reconstructing images of deceased people's faces from old photos, serving cultural and heritage archival purposes,

Applications in e-commerce, medical aesthetics, augmented reality.

The development and application of VKIST face capture not only helps VKIST take the initiative in building large databases but also contributes to improving research capacity on computer vision and artificial intelligence in Vietnam - core areas in the fourth industrial revolution.

Mastering and mastering software technology to control specialized hardware systems - especially multi-device optical systems - plays an important role in building domestic AI platforms suitable for the anthropometric characteristics of Vietnamese people.

VKIST face capture is a demonstration of the development of high-tech software tools for research and deployment of computer vision systems in Vietnam. Mastering the technology of controlling and synchronizing large-scale image data collection systems will be an important foundation to help promote the capacity to develop artificial intelligence in the country, especially in fields that require anthropometric data with regional or ethnographic characteristics.

The IT department registered the copyright of the "VKIST face capture" software immediately after completing and testing the entire program.

*Certificate of copyright registration for VKIST face capture software.*

Vietnam - Korea Institute of Science and Technology

Source: https://mst.gov.vn/vkist-face-capture-phan-mem-thu-thap-du-lieu-anh-khuon-mat-da-goc-phuc-vu-nghien-cuu-va-phat-trien-ai-197250927011551324.htm