DE Jobs

Search from over 2 Million Available Jobs, No Extra Steps, No Extra Forms, Just DirectEmployers

Job Information

DevCare Solutions Senior Data Engineer in Columbus, Ohio

DevCare Solutions is looking for Senior Data Engineers to work in Westerville, OH and various unanticipated locations throughout the U.S. Requires a Master's degree or foreign equivalent in Computer Information Systems or related field and exp. in Hive, Python, Hadoop, Pig, HBase, Kafka, Spark, Jenkins and Java. Send resumes, REF. 1253.161 to ram@devcare.com. Job Duties: Design and develop an API for TSI Prioritization Program objects thru Python; Design and implemented a pipeline to GET/POST data from .Net applications using Python; Extract geometry/maps data from ARCGISPro and transformed the dataframe data using geopandas, pandas and numpy to get TSIScores; Created, managed , and shared the geographic maps using ARCGISPro and analyzed the same using python objects; Design and implemented identifying the source and the target files responsible and dependencies for intersection scoring ad location refinement and targeted the outputs towards the topic; Work on processing Intersection scores, intersection segments, address points, intersection segment psi refined data using python objects; Validate the final TSI Scores generated data manually; Schedule all the python application using windows task scheduler in the production environment; Create an hive table when required to ingest the final TSIScores data in the HDFS environment; Create and update TSI Prioritization Model technical documents on the applications developed and provided to the team; Work on GITHub to move the code from local to Stage and to Prod; Work on Jenkins to move the code from Stage to Prod; Monitor windows task scheduler jobs on the runs and fixed if there were any failures; Working in building scheduling applications and the multi node clusters from the scratch with Hadoop/System admins and architects. Use of Hive, Python, Hadoop, Apache, Spark, Jenkins and Java. Position may require travel. Minimum Requirements: Education: Master's degree or foreign equivalent in Computer Information Systems or related field. Experience: 6 months experience in the position offered or in a related position. Special Requirements: Aforementioned 6 months of experience must include use of the following: Hive, Python, Hadoop, Apache, Spark, Jenkins and Java.

DirectEmployers