Titulo Estágio
Automotive 3D Simulation with Hardware in the Loop using NVIDIA Isaac
Áreas de especialidade
Engenharia de Software
Sistemas Inteligentes
Local do Estágio
Coimbra
Enquadramento
Título do estágio: Automotive 3D Simulation with Hardware in the Loop using NVIDIA Isaac
Áreas de especialidade: Sistemas Inteligentes / Engenharia de Software
The development and testing of complex embedded systems for automotive vehicles requires an effective platform that can reproduce real-world operating conditions and evaluate controller performance. One of the most used techniques for this purpose is hardware-in-the-loop (HIL) simulation, which consists of connecting the embedded system to a real-time computer that executes a virtual representation of the physical model of the vehicle and the environment.
HIL simulation allows you to test the embedded system in varied and challenging scenarios, without the costs and risks associated with using a real vehicle. Additionally, HIL simulation facilitates error detection and correction, parameter optimization, and requirements validation.
Objetivo
The main objective of this project is to develop a simulation environment for a motor vehicle using NVIDIA Isaac software, with the inclusion of HIL to test and validate the vehicle's embedded system in different scenarios and conditions.
HIL simulation also has some limitations, such as the difficulty of accurately modeling all aspects of the vehicle and environment, the need to emulate electrical signals from sensors and actuators, and the dependence on a real-time computer with enough capacity to run the model in real time.
To mitigate these limitations, NVIDIA Isaac platform will be used. NVIDIA Isaac is an integrated platform for the development, simulation and deployment of robotics and artificial intelligence (AI) applications. NVIDIA Isaac software allows the creation of photorealistic and physically accurate simulation environments using NVIDIA Omniverse, a scalable application that can be run locally or in the cloud. It facilitates integration with the Robot Operating System, using Isaac ROS.
Summarising, this internship has a strong engineering focus and encompasses, with hardware in the loop, the design of an automotive vehicle environment and populate it with passengers, as well as the simulation of events such as door opening and light control.
Plano de Trabalhos - Semestre 1
- Literature review on the simulation of the interior of a train carriage and the NVIDIA Omniverse platform.
- Model the vehicle and add materials, textures, lighting, and shadows, making sure the model is consistent with the physical properties and appearance of the real vehicle.
- Create and animate other vehicles, pedestrians, and traffic signs. Place them in the simulation environment according to the desired scenario and use cases.
- Define the initial and final conditions such as the speed, direction, location, and time of the vehicle, as well as the traffic and road conditions.
- Implement the simulation rules and events. Use the NVIDIA Isaac ROS software stack to program the logic and behaviour of the vehicle and the other elements.
- Use the HIL under test with the Isaac ROS nodes for image processing, DNN, and CV to enable the vehicle to detect and track objects. Use the Isaac ROS nodes for mapping and localisation to enable the vehicle to navigate the environment, as well as for control and planning to enable the vehicle to perform actions such as steering, braking, accelerating, turning, collision detection, and lane keeping.
- Run, visualize the simulation and analyse the results Observe how HIL under test, the vehicle and the other elements interact and behave in the simulated environment. Evaluate the performance of the HIL under test and vehicle in terms of the passenger’s comfort, safety, and efficiency.
- Final project report redaction.
Plano de Trabalhos - Semestre 2
- Literature review on the simulation of the interior of a train carriage and the NVIDIA Omniverse platform.
- Model the vehicle and add materials, textures, lighting, and shadows, making sure the model is consistent with the physical properties and appearance of the real vehicle.
- Create and animate other vehicles, pedestrians, and traffic signs. Place them in the simulation environment according to the desired scenario and use cases.
- Define the initial and final conditions such as the speed, direction, location, and time of the vehicle, as well as the traffic and road conditions.
- Implement the simulation rules and events. Use the NVIDIA Isaac ROS software stack to program the logic and behaviour of the vehicle and the other elements.
- Use the HIL under test with the Isaac ROS nodes for image processing, DNN, and CV to enable the vehicle to detect and track objects. Use the Isaac ROS nodes for mapping and localisation to enable the vehicle to navigate the environment, as well as for control and planning to enable the vehicle to perform actions such as steering, braking, accelerating, turning, collision detection, and lane keeping.
- Run, visualize the simulation and analyse the results Observe how HIL under test, the vehicle and the other elements interact and behave in the simulated environment. Evaluate the performance of the HIL under test and vehicle in terms of the passenger’s comfort, safety, and efficiency.
- Final project report redaction.
Condições
A computer and work post will be provided
Internship scholarship
Orientador
Luis Conde Bento
luis.conde@criticalsoftware.com 📩