Data Engineer
at Axiom Software Solutions Limited
Software Development Agency
Business Consulting
Apply Now
Already Applied? Save to tracker
About the job
ONSITEWFH 5 days a weekDerby, Derbyshire, EnglandFull-Time ~ Contract
Open to new applications
3 job requirements
Preview the competition
| 1 years JSON experience, used daily | Must Have | |
| 1 years Python experience, used daily | Must Have | |
| 1 years Spark experience, used daily | Must Have |
Job title: Data Engineer
Location: UK
Duration: 6-month contract Inside IR35
Working Mode: Fully Remote
Vetting: Active SC Clearance
:
Data Engineer Skills and Technologies Data Engineering:
- Strong understanding of data concepts
- data types, data structures, schemas (both JSON and Spark), schema management etc
- Strong understanding of complex JSON manipulation - Experience working with Data Pipelines using a custom Python/PySpark frameworks
- Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
- Strong understanding of Data Security principles
- data owners, access controls
- row and column level, GDPR etc including experience of handling sensitive datasets
- Strong problem solving and analytical skills, particularly able to demonstrate these intuitively
Requirements
Required Skills:
Languages / Frameworks
- JSON
- YAML
- Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
- SQL
- PySpark
- Delta Lake
- Bash (both CLI usage and scripting)
- Git
- Markdown
- Scala (bonus, not compulsory)
- Azure SQL Server as a HIVE Metastore (bonus) Technologies
- Azure Databricks
- Apache Spark
- Delta Tables
- Data processing with Python
- PowerBI (Integration / Data Ingestion)
- JIRA
Sign up for free or Log in to see all company info and tab sections contents.
AS
Axiom Software Solutions Limited
Classification:
blurTagText
blurTagText
Enable 1-click access to other sources:
and more
Do your research faster with Quick Links
Sign up for free or
Log in to see key dates, hiring stages, people, and contact details where applicable.
Details and stages
Reporting to: details unknown
the hiring process information will appear here if available.
Sign up for free or
Log in to view all job posting insights and get access to competitive insights.
Job ref blurredText
Posted on blurredText
Last checked on blurredText
Closing on blurredText
1 discussion comments
0 requirements
4 Saved as Applied
Qualify To Apply check resultsTotal attempts: 22 Unique: 10 Passed: 6
Understand who you are up against with Competitive Insights
Discuss this job
Share your intel on this vacancy and help others - anonymously
Log in to view and post comments.
Team inkscroll - 0 days ago
pretend that this is a blurredText long comment