542 - Cloudera Developer

We need an English-fluent Cloudera Developer, based in Latin America, available to work remotely.

We are looking for someone with exceptional communication and relationship-building skills, who embraces changes while maintaining strong attention to detail. An interested and proactive person, who's constantly learning and improving their skills.

Are you the one we are looking for?

Responsibilities:

• Design, develop, and maintain data processing pipelines using Cloudera technologies such as Apache Hadoop, Apache Spark, Apache Hive, and Apache Kafka.
• Collaborate with data engineers and data scientists to understand data requirements and translate them into technical specifications.
• Develop and maintain data ingestion frameworks for efficiently extracting, transforming, and loading data from various sources into the Cloudera platform.
• Optimize and tune data processing jobs to ensure high performance and scalability.
• Implement data governance and security policies to ensure data integrity and compliance.
• Monitor and troubleshoot data processing jobs to identify and resolve issues in a timely manner.
• Perform unit testing and debugging of data solutions to ensure high quality and reliability.
• Document technical specifications, data flows, and data architecture diagrams.
• Stay updated with the latest advancements and best practices in Cloudera technologies and big data analytics.

Requirements:

• Experience working with Cloudera Development
• Experience with Cloudera Cluster management, configuration, administration, protection, and performance management.
• In-depth knowledge of SQL and experience with database systems.
• Familiarity with data modeling and data integration techniques.
• Experience with data ingest platform
  • Dealing with various data types
  • Building exception frameworks and scorecarding data
  • Data integration with existing sub-systems
• Experience with Data ETL
  • Treatment and transformation of data
  • Data processing
• Experience with Data SQL and NoSQL
• Understanding of distributed computing principles and distributed file systems.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills to work effectively in a team environment.
• Ability to manage multiple tasks and prioritize work effectively.