Join 📚 Kevin's Highlights
A batch of the best highlights from what Kevin's read, .
Agile Testing Method and Best Practices
Edward Nick
When we unpack the common threads of how various people define data engineering, an obvious pattern emerges:
a **data engineer**
*gets data, stores it, and prepares it for consumption*
by **data scientists**, **analysts**, and others.
We define data engineering and data engineer as follows:
**Data engineering** is
the *development*, *implementation*, and *maintenance*
of **systems** and **processes** that take in raw data
and produce high-quality, consistent information
that supports downstream use cases,
such as analysis and machine learning.
**Data engineering** is
the intersection of
*security*,
*data management*,
*DataOps*,
*data architecture*,
*orchestration*, and
*software engineering*.
A **data engineer**
*manages the data engineering lifecycle*,
beginning with getting data from source systems and
ending with serving data for use cases,
such as analysis or machine learning.
Fundamentals of Data Engineering
Reis, Joe;Housley, Matt;
“If I want to launch a disinformation campaign,
I can fail 99 percent of the time.
You fail all the time,
but it doesn’t matter,” Farid says.
“Every once in a while,
the QAnon gets through.
Most of your campaigns can fail,
but the ones that don’t can wreak havoc.”
How AI May Be Used to Create Custom Disinformation Ahead of 2024
Thor Benson
...catch up on these, and many more highlights
Readwise