Job Details

Email to Friend Save Back

Senior Big Data Engineer

NEW YORK-10010, NY, US
08/17/2018

-

Required Skills

programming languages

Company

Infinity Consulting Solutions, Inc

Experience

Job Description

Senior Big Data Engineer

FT Position with NYC Fintech company

Excellent compensation and bonus plans

We are looking for a self-motivated Senior Big Data Engineer who is passionate about supporting and building high-quality tools.

The role involves combining cutting-edge open source and proprietary technology to support back-end systems

written in C++ and front-end systems using Angular and NodeJS, improve supporting tools and infrastructure,

create fast C++ build systems and improve workflows.

Responsibilities

• Using dynamic programming languages, such as Scala and Python to architect, implement and integrate data

analytics tools for financial markets

• Proactively assisting other developers in diagnosing and solving issues with development and build environments

• Establishing and improving infrastructure in support of production, QA, and development systems

• Implementation of system monitoring infrastructure and tools, including dashboards

• Monitoring systems for issues in real-time, responding to them as they occur, and working proactively to

minimize future issues

• Level 3 support Requirements

Qualifications

• 5+ years of experience building large scale big data applications (spark streams, kafka streams, HDFS internals)

• Proactive with a high attention to detail and ability to manage multiple projects simultaneously

• Strong working knowledge of the Linux operating system, including basic system administration and a high

degree of comfort working from the command line

• Experience with version control software and SDLC principles

• Strong programming skills using Scala and Python

• Experience with containers, orchestration and CI/CD pipelines

• Experience with Open Source software including Puppet, Jenkins, Nagios, GNU make, Redmine, OpenLDAP,

FreeRADIUS, BIND, collectd, Graphite, Grafana, Hypertable, consul, zookeeper, and PostgreSQL are a bonus

• Financial experience is not required