Cloudera Python Developer

Responsibilities:
• Work with different technology teams across infrastructure, and other divisions to deliver system solutions for the business.

• Involve in development and system integration relevant systems with CDP / CDSW.

• Hands-on experiences on Big Data solution and development based on Python technologies stack to design and implement secure, scalable and high-performance data processing pipelines.

• Responsible for documentation of design, build and implementation deliverables owned by the individual and present it when needed.

• Build a strong relationship and manage expectations with users and stake holders.

Education:
• Bachelor’s degree in computer science or related field.

• At least 3 years’ relevant experience.

Essential:
• Strong understanding of Cloudera framework includes CDP (Cloudera Data Platform) and CDSW (Cloudera Data Science Work Bench)

• Experience in implementing Data security and access control using Ranger/Atlas

• Must have working understanding of Hadoop, Hive and Spark/pySpark architect

• Experience in python web-application frameworks (Django)

• Experience in shell scripting, automation and troubleshooting technical issues.

• Other good to have skill sets include global market products:

• Experience working in the financial industry with relevant experience in core data science using Cloudera platform based on Python technologies stack.

• Previous experience on Data science project and understand the global markets products and its underlying pricing components (Market data analytics and identifying risk factors affecting pricing of the products)

• Experience in Cloudera manager to monitor Hadoop services.

• Good knowledge and working experience in Hadoop administration (incl. Hive, Impala, Kafka, zookeeper etc.).

• Hands-on Techno-Functional role to analysis and propose solutions for business issues, process changes and functional requirements.

• Strong team player with excellent communication & inter-personal skills.

• Strong problem solver who can question and understand proposed solutions and business drivers.