Published inData Engineer ThingsData Privacy Techniques in Data EngineeringAs data engineers, we develop pipelines to process sensitive data. We must be aware of data privacy regulations and ensure our pipelines…Feb 3, 2024Feb 3, 2024
Iterative and incremental approach in system designEngineers, whether they’re data, software, or DevOps, often strive to build or design the perfect solution. They tend to focus…Jan 18, 2024Jan 18, 2024
How source systems developers can help Data team.Finally, I’ve gathered some advice for developers who develop/design systems which later can be used as sources for Data Lakes/Analytical…Oct 18, 20217Oct 18, 20217
Published inData Engineer ThingsMonitoring Data Quality with Amazon DeequArticle purposeApr 5, 2021Apr 5, 2021
Apache Atlas- Quick start (Part II — Java API on Scala)Part I of the article available here where you can find an example of how to work with Atlas REST API & UI.Oct 11, 2020Oct 11, 2020
Apache Atlas- Quick start (Part I — REST & UI)The article aims to show base steps to work with Apache AtlasOct 6, 20201Oct 6, 20201