Data Engineer - Costa Rica - Contract
Very LLC
- Costa Rica
- Autónomo
- Tiempo completo
- Understand our clients’ industries and work with the teams to deliver industry-relevant solutions
- Collaborate with data scientists and analysts to understand data requirements and provide scalable solutions
- Optimize and troubleshoot Spark core, partitioning, and logs
- Utilize pandas for data manipulation and analysis
- Implement delta format for efficient data storage and processing
- Implement AWS services for ingestion, storage, and visualization
- Terraform, Python
- 3-5 years of experience in data engineering or related roles
- Hands-on experience with AWS
- Proficiency in Python and SQL, with advanced skills preferred for a senior role
- Experience with Spark core, partitioning, and logs troubleshooting
- Familiarity with pandas for data manipulation
- Experience with delta format for data storage and processing
- Experience with Git
- Strong understanding of data warehouse modeling, database design patterns, and table design patterns
- Experience with Terraform
- Experience of AWS services such as IAM, EC2, S3, and Lambda is a plus
- Experience with batch and stream ingestion processes is a plus
- Experience designing and implementing automation tools and frameworks for continuous integration, delivery, and deployment is a plus
- Experience with visualization tools such as Power BI is a plus