Data Engineer

We are seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines that power our analytics platforms. This role requires deep expertise in cloud-based environments, particularly AWS, and a strong ability to integrate data from diverse sources to support tools like Amazon QuickSight and Qlik Sense.

Key Responsibilities

• Develop and maintain robust data pipelines using batch and real-time processing frameworks.
  
• Integrate data from multiple sources, ensuring consistency and reliability.
  
• Optimize data workflows for performance, scalability, and cost-efficiency.
  
• Collaborate with analytics and BI teams to support reporting and dashboarding needs.
  
• Implement best practices for data architecture, governance, and security.
  
• Monitor and troubleshoot data pipeline issues and ensure high availability.
  
• Document data processes and contribute to continuous improvement initiatives.
  

Requirements

• Proven experience in building large-scale data pipelines using both batch and streaming technologies.
  
• Strong proficiency with AWS services (e.g., Glue, Lambda, Kinesis, Redshift, S3).
  
• Experience integrating and transforming data from various sources.
  
• Familiarity with BI tools such as Amazon QuickSight and Qlik Sense.
  
• Advanced level of English (spoken and written).
  
• Strong problem-solving and communication skills.
  
• Ability to work independently in a remote environment.

Preferred Skills

• Proficiency in programming languages such as Python, SQL, or Scala.
  
• Experience with data orchestration tools (e.g., Apache Airflow).
  
• Knowledge of data warehousing and ETL best practices.
  
• Background in agile development and DevOps principles.
  

Benefits

• Continuous training program
  
• Talks and workshops on personal and professional growth
  
• Organizational team building events
  
• Rewards
  
• Social Responsibility committee
  
• Wellness Subsidy
  
• PTO’s
  
• Developer’s day celebration
  
• Birthday off
  
• Monthly kudos
  
• Holiday celebration day off
  
• 70+ Partnerships with restaurants, hotels, hiking groups, fitness, stores, medical services, psychology services, dental services, universities, pet supply services, pet medical pharmacy chains, events, and car services.