Job Details

Email to Friend Save Back

Data Engineer

NEW YORK-10010, NY, US
07/05/2018

-

Required Skills

scripting languages

Company

Infinity Consulting Solutions, Inc

Experience

Job Description

Why do we want you?

You're an ambitious, driven developer looking to play a key role in the design, development and

implementation of cutting edge, highly-scalable applications based on large amounts of

unstructured/structured data. You're passionate about open source and Big Data technologies. You want the opportunity

to collect, parse, manage, analyze, and visualize large data sets to extract meaningful knowledge.

And you dream of working with NoSQL database technologies and fun, emerging data science

techniques. As part of a small team of experts, you have a strong desire to contribute to important

endeavors to address critical needs of Fortune 500 companies.

Responsibilities

• Work with an amazing team to design and develop modern distributed Big Data processing and

analysis systems

• Utilize primarily open source development tools and code frameworks (e.g. Git, Storm)

• Define and manage development tasks within an agile team

• Utilize unit tests and deploy code to live systems

• Work closely with customers and incorporate feedback into development activities

• Gracefully accept criticism when you make a less-than-stellar lunch recommendation

Skills & Qualifications

Must have:

• Strong object-oriented programming or functional language experience (Clojure preferred, Java

also ok)

• Programming with scripting languages (e.g. Python, Perl, Bash, etc)

• Proficient in UNIX/Linux environments (we work on Macs and deploy to Ubuntu on AWS)

• Strong knowledge of programming structures and algorithms

• Excellent oral and written communications skills

• Paint like Bob Ross (or the ability to fake it)

Nice to have:

• Distributed, fault-tolerant architectures (Storm experience preferred, Spark or Hadoop ok)

• Working with NoSQL databases and JSON data (ElasticSearch preferred)

• Working with messaging/queueing systems (RabbitMQ preferred)

• Working with SQL databases and large-scale data integration (MySQL preferred)

Third Party Applications Not Accepted