Senior Developer - Big Data

- Develop in Big Data architecture, Hadoop stack including HDFS cluster, MapReduce, Hive, Kafka, Storm, Heron, Flink, Spark, Elasticsearch/Solr and NoSQL

- Migrate Data from relational databases to Hadoop HDFS

- Hands on development  in JAVA / Python

- Assist and support proof of concepts as Big Data technology evolves.

- Ensure solutions developed adhere to security and data entitlements

- Translate functional and technical requirements into detail design

Qualification:

Must Have

- 3 years’ experience developing in Big Data architecture, Hadoop stack including HDFS cluster, MapReduce, Hive, Kafka, Storm, Heron, Flink, Spark, Elasticsearch/Solr and NoSQL

- 3 years’ experience in data migration from relational databases to Hadoop HDFS

- 5 years Hands on development experience in JAVA / Python

- 5+ years hands-on experience working in traditional RDBMS such as Oracle, DB2, MySQL and/or PostgresSQL.

- 3-5 years hands-on experience writing SQL and working in Data Warehouse developing ETL processes

- Hands-on experience writing stream processing pipelines.

- Hands-on experience setting up and tuning Hadoop clusters

- Hand-on experience with iLabs integration and Enterprice Integration Patterns

- Translate, load and present disparate data sets in multiple formats/sources including JSON

- Translate functional and technical requirements into detail design

- Application performance tuning and troubleshooting

- Participate in analysis of data stores and help with data analytics

Nice-to-have

- Experience with Docker or other containerization technologies

- Experience with Mesos or similar

- Hand-on experience developing Cloud applications. Experience with Cloud  Foundry is a plus

- Experience developing Microservices architecture

- Experience working in start-ups or open source contributor

- Excellent oral and written communication skills and the ability to clearly articulate to all project members and stakeholders

- Must be a team player who works well with technical and non-technical resources

- Must be able to see tasks through to completion without significant guidance

- Experience with Agile development methodologies a plus

More Information / Apply Now launch

Type

Corporate / senior

New York City , United States

Location

United States

New York City

Type

Corporate / senior