• Avanade
  • $108,145.00 -170,900.00/year*
  • Athens , NY
  • Information Technology
  • Full-Time
  • 44 Flats Rd


Loading some great jobs for you...




Role Overview:

As a Big Data/PySpark Engineer at Avanade, you will have a deep understanding of the architecture, performance characteristics and limitations of modern storage and computational frameworks, with experience implementing solutions that leverage: HDFS/Hive; Spark/MLlib; Kafka, etc. You will have knowledge in Apache Spark and/or Python programming, deep experience in developing data processing using PySpark such as reading data from external sources, merge data, perform data enrichment and load into target data destinations. Deep experience in developing data processing tasks using PySpark such as reading data from external sources, merge data, perform data enrichment and load into target data destinations. Knowledge of python packaging, azure/data lake, and data bricks. Experience with ML. Manage large volumes of structured and unstructured data and extract & clean data to make it amenable for analysis. 80% travel is required.

Locations: Boston, MA, Hartford, CT, New York, NY, Philadelphia, PA

Key Technologies:Must haves:Apache SparkPythonPySparkHadoopSQL

Pluses:Azure or AWSTensorFlowApache airflowSnowflakeLinux OS

.Key Role Responsibilities:Demonstrated expertise working with and maintaining open source data analysis platforms, including but not limited to:Pandas, Scikit-Learn, Matplotlib, TensorFlow, Jupyter and other Python data toolsSpark (PySpark), HDFS, Kafka and other high-volume data toolsSQL and NoSQL storage tools, such as MySQL, Postgres, Cassandra, MongoDB and ElasticSearchDeep understanding of the architecture, performance characteristics and limitations of modern storage and computational frameworks, with experience implementing solutions that leverage: HDFS/Hive; Spark/MLlib; Kafka, etc.Technical background in computer science, data science, machine learning, artificial intelligence, statistics or other quantitative and computational scienceHands-on experience using Big Data and statistical analysis tools such as Hadoop/Spark, SQLExperience transforming Data at a scale using Spark/PySparkWorking experience with Linux OS (Redhat/UbuntuExcellent communication skills (speaking, presenting)

Preferred Education Background:You likely possess MS/ Ph.D. in a quantitative field such as computer science, applied mathematics, statistics, or machine learning. An equivalent combination of education and experience will also suffice.

Preferred Years of Work Experience:You likely have about 2-5+ years of relevant professional experience.

About AvanadeAvanade leads in providing creative digital services, business solutions and design-led experiences for its clients, delivered through the power of people and the Microsoft ecosystem. Our professionals combine technology, business, and industry expertise to build and deploy solutions to realize results for clients and their customers. Avanade has 27,000 digitally connected people across 23 countries, bringing clients the best thinking through a collaborative culture that honors diversity and reflects the communities in which we operate. Majority owned by Accenture, Avanade was founded in 2000 by Accenture LLP and Microsoft Corporation. Learn more at www.avanade.com.Why Avanade?14-time winner of Microsoft Partner of the Year24,000+ certifications in Microsoft technology90+ Microsoft partner awards17 Gold Competencies3,500 analytics professionals worldwide1,000 data engineersImplemented analytics systems for more than 550 clients400 AI practitioners300 cognitive service experts

We champion creativity and free-thinking, embrace diversity, and believe innovation is powered by people working together to change things for the better.

Employment TransparencyAvanade Is An Equal Opportunity Employer. Avanade prohibits discrimination and harassment against any employee or applicant for employment because of race, color, age, religion, sex, national origin, gender identity or expression, sexual orientation, disability, veteran, military or marital status, genetic information or any other protected status.

The EEO is the Law poster is available here

and poster supplement is available here

The Pay Transparency Policy is available here

Avanade is committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation due to a disability for any part of the employment process, please send an e-mail to Avanade at ...@avanade.com or call (206) ###-#### and let us know the nature of your request and your contact information.

By using this site, you agree that we can place Cookies on your device. See our Job Applicant Data Privacy Statement and Cookies statement.


Associated topics: application, c#, develop, matlab, perl, php, sde, software developer, software development engineer, software engineer

* The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.

Launch your career - Upload your resume now!

Upload your resume

Loading some great jobs for you...