Big Data Engineer – NY – 12 Months

Role- Big Data Engineer

Location- NYC, NY

Duration- 12 Months

Job Description:

• A formal background and proven experience in engineering, mathematics and computer science, particularly within the financial services sector
• Hands on Programming / Scripting Experience (Python, Java, Scala, Bash)
• Hands on with Ansible playbooks and create Hadoop builds and deployments
• DevOps Tools (Chef, Docker, Puppet, Bamboo, Jenkins)
• Linux / Windows (Command line). An understanding of Unix/Linux including system administration and shell scripting
• Proficiency with Hadoop v2, MapReduce, HDFS, Spark
• Management of Hadoop cluster, with all included services
• Good knowledge of Big Data querying tools, such as Pig, Hive, Impala and Spark
• Data Concepts (ETL, near-/real-time streaming, data structures, metadata and workflow management)
• The ability to function within a multidisciplinary, global team. Be a self-starter with a strong curiosity for extracting knowledge from data and the ability to elicit technical requirements from a non-technical audience
• Collaboration with team members, business stakeholders and data SMEs to elicit, translate, and prescribe requirements. Cultivate sustained innovation to deliver exceptional products to customers
• Experience with integration of data from multiple data sources
• Strong communication skills and the ability to present deep technical findings to a business audience