Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
podcast
Filter by Categories
Print Category 1
Print Category 2
Uncategorized

Data Engineer

NYC Careers

BenefitsPulled from the full job descriptionLoan forgiveness

THE AGENCY

The Department of City Planning (DCP) plans for the strategic growth and development of the City through ground-up planning with communities, the development of land use policies and zoning regulations applicable citywide and sharing its perspectives on growth and community needs with sister agencies in collaboration with the Office of Management and Budget (OMB).

DCPs six strategic objectives include: (a) catalyze long-term neighborhood improvement through integrated planning and targeted accompanying public investments; (b) encourage housing production, affordability, and quality; (c) promote economic development and job growth; (d) enhance resiliency and sustainability of neighborhoods; (e) ensure integrity, timeliness and responsiveness in land use reviews; and, (f) supply objective data and expertise to a broad range of planning functions and stakeholders.

Central to its mission, DCP supports the City Planning Commission in its annual review of approximately 450 land use applications. The Department also works closely with OMB in developing the Ten-Year Capital Strategy, and helping administer the Neighborhood Development Fund, geared toward ensuring that growing neighborhoods undergoing rezoning have accompanying infrastructure investments.

The New York City Department of City Planning is a great place to work cultivating intellectual inspiration, professional development and creativity. Visit our website at www.nyc.gov/planning to access the full listing of job opportunities and to learn more about our great agency.

THE DIVISION:

The Information Technology Division (ITD) is responsible for supporting the agencys technology footprint, including technology infrastructure across five boroughs, as well as workflow applications and databases for analytics and decision-making. The division is comprised of 50+ inter-disciplinary staff with specialties in application development, database maintenance, data processing, data visualization and mapping, desktop support, server engineering, and telecom, amongst many others. The division provides technology support for agency staff across five boroughs.

Within ITD, the Enterprise Data Management (EDM) section is responsible for creating and implementing the agencys data strategy and data governance policy; updating and maintaining core citywide datasets in support of 911 dispatch and the operations of city agencies; and improving the creation, use, and availability of geospatial data sets within the agency.

THE ROLE

ITDs Enterprise Data Management (EDM) section is seeking a Data Engineer to join the Data Engineering team. DCPs Data Engineering teams mission is to create and publish high quality public datasets, build transparent and automated data pipelines using open-source technologies, develop a data ecosystem by offering comprehensive documentation and analytics resources, and bring people together across teams and agencies to share data and learn from each other. The Data Engineering team is continually evolving, and this new hire will have the ability and support to improve existing infrastructure and processes, while driving forward new projects and initiatives. The ideal candidate will be passionate about data literacy, quality, and accessibility, and excited about advancing the adoption of new technologies in DCP and City government.

Under limited supervision, the Data Engineers primary areas of responsibility include, but are not limited to:

Designing, deploying, and scaling of current infrastructure to ensure that Data Engineering maintains and improves existing processes, and expands its abilities and offerings.
Understanding the technologies used by the team and recommending new technologies. Ideating, designing, and implementing improvements to products and processes to ensure that the team is using the best tools for the job.
Building Data Engineering data products, which involves:
Operating data ingestion pipelines and managing data storage,
Running scripts that transform input data by standardizing text fields, geocoding, merging, aggregating, and performing basic spatial manipulations, and
Reviewing outputs by writing custom scripts and/or using established QAQC tools to identify errors, inconsistencies, and edge cases in datasets.
Working with the team to design new data products from concept to completion, collaborating with product owners, creating technical designs with team members, providing input to help to plan sprints, contributing to documentation, and delivering a finished product.
Collaborating with other data engineers.
Learning legacy data systems and bringing the infrastructure into a modern development stack.
Sharing your accomplishments and lessons learned with NYC Planning, other city agencies, and the world via talks, presentations, blogs, or other mediums.

Minimum Qual Requirements

(1) A baccalaureate degree from an accredited college, including or supplemented by twenty-four (24) semester credits in computer science or a related computer field and two (2) years of satisfactory full-time software experience in designing, programming, debugging, maintaining, implementing, and enhancing computer software applications, systems programming, systems analysis and design, data communication software, or database design and programming, including one year in a project leader capacity or as a major contributor on a complex project; or
(2) A four-year high school diploma or its educational equivalent and six (6) years of full-time satisfactory software experience as described in 1″ above, including one year in a project leader capacity or as a major contributor on a complex project; or
(3) A satisfactory combination of education and experience that is equivalent to (1) or (2) above. College education may be substituted for up to two years of the required experience in (2) above on the basis that sixty (60) semester credits from an accredited college is equated to one year of experience. A masters degree in computer science or a related computer field may be substituted for one year of the required experience in (1) or (2) above. However, all candidates must have a four year high school diploma or its educational equivalent, plus at least one (1) year of satisfactory full-time software experience in a project leader capacity or as a major contributor on a complex project.
NOTE: In order to have your experience accepted as Project Leader or Major Contributor experience, you must explain in detail how your experience qualifies you as a project leader or as a major contributor. Experience in computer operations, technical support, quality assurance (QA), hardware installation, help desk, or as an end user will not be accepted for meeting the minimum qualification
requirements.
Special Note
To be eligible for placement in Assignment Level IV, in addition to the Qualification Requirements stated above, individuals must have one year of satisfactory experience in a project leader capacity or as a major contributor on a complex project in data administration, database management systems, operating systems, data communications systems, capacity planning, and/or on-line applications programming.

Preferred Skills

Two or more years of experience in the field of data engineering
Proficient in scripting processes with Python and SQL
Comfortable working and collaborating in GitHub with an understanding of git version control
Proficient in automating processes using GitHub Actions and bash
Knowledge of and experience with DevOPs using a containerization software such as Docker
Practical experience with open-source enterprise relational databases, such as PostgreSQL
Experience working with spatial data in PostGIS, Carto, GeoPandas, or GDAL
Organized and detail oriented with the ability to bring logic to heterogeneous data environments
Seeks out learning resources and team-member guidance to fill knowledge gaps
Able to work in a collaborative development environment
Able to think critically to learn and wrangle complex data systems
Able to communicate to both technical and non-technical audiences.

Additional Information

NOTE: ONLY CANDIDATES WHO HAVE A PERMANENT COMPUTER SPECIALIST (SW) OR COMPARABLE CIVIL SERVICE TITLE WILL BE CONSIDERED FOR AN INTERVIEW. PLEASE INCLUDE YOUR EMPLOYEE IDENTIFICATION NUMBER (EIN) WHEN APPLYING AND INDICATE IN YOUR COVER LETTER IF YOU ARE A PERMANENT COMPUTER SPECIALIST (SW) OR IN A COMPARABLE TITLE.

To Apply

Only applicants under consideration will be contacted. Appointments are subject to Office of Management and Budget (OMB) approval.

Click on Apply Now at the bottom of the posting
Please be advised only candidates under consideration will be contacted.
Appointments are subject to Office of Management and Budget (OMB) approval.
Authorization to work in the United States is required for this position.
This position requires unrestricted work authorization and DCP does not offer sponsorship. Only eligible candidates need apply.

The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual’s sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.

As a current or prospective employee of the City of New York, you may be eligible for federal loan forgiveness programs and state repayment assistance programs. Please review the notice to see if you may be eligible for programs and how to apply at nyc.gov/studentloans.

55-a Program

This position is also open to qualified persons with a disability who are eligible for the 55-a Program. Please indicate at the top of your resume and cover letter that you would like to be considered for the position through the 55-a Program.

Residency Requirement

New York City Residency is not required for this position

Hiring InsightsJob activityPosted 9 days ago

Tagged as: