Cloud AWS Engineer - Collibra

Location : San Francisco, CA

Duration:- 6 Months / Remote

Qualifications:

Looking for 7-8 years experience

• Must have Business Acumen skills to understand and anticipate business priorities
• Must have experience using Gitlab to build CI/CD pipelines.
• Must have experience writing IAC code using Terraform to deploy AWS resources.
• Must have experience using AWS services including EC2, IAM, Lamda and KMS, Rt 53
• Must have experience writing Unix Shell scripts.
• Must be familiar with Agile methodologies and able to work in an Agile manner
• Must have a very strong application development background
• Experience with using AWS EKS.
• Demonstrates mutual respect, embraces diversity, and acts with authenticity
• Demonstrates analytical and problem-solving skills
• Experience in designing and building large-scale solutions in an enterprise setting in both On-Prem /AWS
• 5+ years in designing and building data services with all aspects of cloud design, development, and implementation
• 3+ years of experience with full stack development, including application, API, testing, and automation experience using at least one of the following languages (Terraform, JSON, Python)
• 3+ years of experience designing, building, and supporting solutions hosted either on-prem or in the cloud, and experience with migrating data to the cloud
• Knowledge of cloud specific solutions related to gateways, streaming services, or file and database migration services
• Hands on experience in one or more programming languages.
• Experience with other AWS data related services including various compute and storage offerings
• Experience with RDS, NOSQL Databases, RDBMS and in-memory databases.
• Experience with data structures, networking, performance, and scalability.

Responsibilities:

• Understand technology vision and strategic direction of business needs
• Develop product roadmaps in alignment with other data products and business roadmaps
• Design integrated solution in alignment with design patterns, blueprints, guidelines, and standard methodologies for products
• Participate in defining technical requirements that outlines solution for enabling data analytics within an AWS cloud environment.
• Participate in developing architecture and design conceptual solutions by incorporating cloud native and 3rd party vendor products
• Provide analysis of current state, future state, and define key outcomes for an IT data platform strategy.
• Participate in research and perform POCs (proofs of concept) with emerging technologies and adopt industry best practices in the data space for advancing the cloud data platform
• Demonstrate automation through Infrastructure as a code to increase build efficiency in the cloud
• Develop scripting to integrate multiple data sources to data and analytics platform
• Build platform supporting rehydration and HA
• Build end to end automation to support and maintain software currency
• Create automation services for builds using Terraform, Python, and OS shell scripts.
• Develop validation and certification process through automation tools
• Develop multi-layered build, installation, configuration, patching, regression testing, and rollback scripts in each environment.
• Integrate platforms to form a cohesive data mesh and help democratize data
• Create patching process to compare different versions of the configuration settings.
• Provide consulting and guidance on business solution development in the data and analytics space and cloud technologies
• Demonstrate leadership, collaboration, exceptional communication, negotiation, strategic and influencing skills to gain consensus and produce the best solutions.

Promote collaboration across business and IT organizations