Actalent s Client R&D group is looking to innovate the efficiency and automation of their data pipeline. This includes how to how to more efficiently and accurately collect customer data through data production, data transformation, and data storage
Analyze system architecture that include smart displays on offhighway equipment, telematics or edge devises, ethernet or CAN communication, cell or wifi communication, cloud computing for ingestion and routing and machine learning processing.
Design and architect scalable and reliable data pipelines to automate data processing workflows.
Development and test software to implement prototype code to prove out designs
Collaborate with data scientists, engineers, and stakeholders to understand data needs and requirements.
Develop and implement ETL processes to transform and load data from various sources into our data warehouse.
Optimize data pipelines for performance, scalability, and efficiency.
Required Qualifications:
BS/MS in Computer Engineering or Computer Science
Experience designing Data Pipeline architecture or similar role with responsibilities including:
Eliciting and capturing detailed requirements from stakeholders
Analyzing requirements to design overall architecture
Documenting architecture in various formats
Performing impact analysis, assessing the effects of modifications on system architecture
Strong proficiency in programming languages such as Python, Golang, or Java
Experience with ETL tools and frameworks (Apache tools, AWS Lambda, ).
Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) their data services, and deployment strategies.
Knowledge of data modeling, database design, and data warehousing concepts.
Experience with container orchestration tools (Docker, Kubernetes)
Ability to create supporting documentation such as design documents, architecture diagrams, test procedures and reports.
Good oral and written communication skills with the ability to professionally support periodic communication to management and technical teams
Experience with Agile Scrum development methodologies and common workflow tools: GIT, Jira, etc
Experience in the off highway heavy machinery, automotive or industrial control industry
Experience designing software for a distributed ECU system using CAN or Ethernet communication