Job DescriptionJob Description
We are looking for a skilled Data Engineer to join our team! This position offers the opportunity to work primarily remotely while contributing to the design, development, and optimization of robust data solutions. Based in Asheville, North Carolina, this role is ideal for professionals with a strong background in building data pipelines and leveraging Azure technologies.
Responsibilities:
• Design, develop, and maintain efficient data pipelines to ensure seamless data integration and processing.
• Utilize Azure Data Factory to create and manage scalable data workflows.
• Implement Python scripts to automate and optimize data-related processes.
• Manage and enhance database systems to ensure data integrity and accessibility.
• Collaborate with cross-functional teams to define data requirements and develop solutions.
• Troubleshoot and resolve issues related to data pipelines and workflows.
• Optimize data storage and retrieval processes to improve system performance.
• Ensure compliance with data governance standards and best practices.
• Monitor and analyze system performance, implementing improvements as necessary.
• Document processes and solutions for future reference and team collaboration.
• At least 10 years of experience in data engineering or related fields.
• Minimum of 5 years of hands-on experience with Azure Data Factory.
• Proficiency in Python scripting for data processing and automation.
• Strong knowledge of building and maintaining data pipelines.
• Familiarity with Azure Pipelines and cloud-based data solutions.
• Proven expertise in database management and optimization.
• Ability to troubleshoot and resolve technical issues in data workflows.
• Excellent communication and collaboration skills to work effectively with teams.