Job Description

We are seeking an experienced Cloud Data Pipeline Engineer to help design, build, and scale the infrastructure that powers advanced mobility systems. This role focuses on supporting large-scale data operations for AI/ML model development across autonomous and intelligent vehicle platforms. As part of the Data Engineering team within the autonomy organization, you’ll play a key role in creating end-to-end pipelines that collect, process, and manage data captured from a wide array of vehicle-mounted sensors. You will work with teams focused on machine learning, perception, and system testing to ensure high-performance access to mission-critical datasets. Key Responsibilities Design and maintain scalable data processing pipelines on AWS , Kubernetes , and on-prem environments. Process and manage structured and unstructured data collected from onboard sensors including cameras, LiDAR, RADAR, and GPS. Build efficient systems for ingestion, parsing, transformation, and storage of multi-terabyte sensor data per day. Optimize data storage, search, and compute performance using distributed architectures, caching layers, and data frameworks. Collaborate with cross-functional teams such as ML, QA, testing engineers, and external annotation vendors to build custom data solutions. Create dashboards and APIs to enable real-time monitoring and integration with ML workflows. Required Qualifications Strong ability to design software architecture based on high-level technical and business needs. Proficient in Python or Golang for backend and data-centric development. Hands-on experience with PostgreSQL or other relational database systems. Professional experience deploying solutions on AWS cloud and Kubernetes clusters. Experience building multi-threaded applications, containerized backends, and RESTful microservices. Preferred Qualifications Strong sense of ownership and a proactive, hands-on problem-solving mindset. Experience developing scalable distributed systems capable of processing terabytes of data daily. Background in autonomous systems or backend engineering for AI/ML data platforms. Familiarity with tools and technologies such as: Airflow, Terraform, Docker, REST APIs, Helm, and SQL . positions at ASICSoft range from $50,000 - $300,000

Job Tags

Similar Jobs