DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Snowflake to Databricks: what the migration actually costs you
zephico profile

Snowflake to Databricks: what the migration actually costs you

#databricks #dataengineering
Comments
5 min read
You Forgot to Mention the 500 Million Rows
raghavsharma_ profile

You Forgot to Mention the 500 Million Rows

#ai #dataengineering #sql #performance
Comments
4 min read
Mastering Databricks Cost Optimisation Without Slowing Teams
vachkov profile

Mastering Databricks Cost Optimisation Without Slowing Teams

#databricks #finops #dataengineering #cloud
Comments
6 min read
Incremental Graph Updates for Corporate Knowledge Graphs: Three Problems Batch Pipelines Can't Solve
hannune profile

Incremental Graph Updates for Corporate Knowledge Graphs: Three Problems Batch Pipelines Can't Solve

#graphdatabases #python #llm #dataengineering
Comments
5 min read
Why CTE vs Subquery Matters More on Redshift Than Anywhere Else
maithreyan11 profile

Why CTE vs Subquery Matters More on Redshift Than Anywhere Else

#redshift #sql #dataengineering #aws
Comments
2 min read
Storix: One Typed Python Filesystem API from Local Development to Cloud Storage
mghalix profile

Storix: One Typed Python Filesystem API from Local Development to Cloud Storage

#showdev #python #cloud #dataengineering
Comments
16 min read
RAG vs. Semantic Layer: Why AI Needs Deterministic Governance
harshit_colrows profile

RAG vs. Semantic Layer: Why AI Needs Deterministic Governance

#dataengineering #database #ai #datascience
Comments
2 min read
Monitoring Airbyte's Postgres CDC Replication Slots Before They Take Down Your Source Database
mukesh_13 profile
Mukesh

Monitoring Airbyte's Postgres CDC Replication Slots Before They Take Down Your Source Database

#airbyte #postgres #cdc #dataengineering
Comments
5 min read
Building Airbyte Connectors That Survive Flaky APIs: Cursor Checkpointing for Resilient Incremental Sync
mukesh_13 profile
Mukesh

Building Airbyte Connectors That Survive Flaky APIs: Cursor Checkpointing for Resilient Incremental Sync

#airbyte #dataengineering #elt #python
Comments
5 min read
100 城时区页给跨区调度当速查，DST 自动算
caresodev profile
tine

100 城时区页给跨区调度当速查，DST 自动算

#dataengineering #database #python #tutorial
Comments
1 min read
Building an Airbyte Destination Connector That Embeds and Dedupes Records Before They Hit pgvector
mukesh_13 profile
Mukesh

Building an Airbyte Destination Connector That Embeds and Dedupes Records Before They Hit pgvector

#airbyte #dataengineering #pgvector #rag
Comments
4 min read
Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys
jitendra_devabhaktuni_0f1 profile

Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys

#api #ai #datascience #dataengineering
Comments
5 min read
How to Run Apache Iceberg & Trino Locally in 60 Seconds (Zero AWS Cost)
ofirnakdai profile

How to Run Apache Iceberg & Trino Locally in 60 Seconds (Zero AWS Cost)

#dataengineering #python #docker #architecture
Comments
2 min read
The Most Underused Prompt in Data Engineering
raghavsharma_ profile

The Most Underused Prompt in Data Engineering

#ai #productivity #dataengineering #learning
Comments
4 min read
Confident Is Not Correct: Three Signs That Claude Is Guessing
raghavsharma_ profile

Confident Is Not Correct: Three Signs That Claude Is Guessing

#discuss #ai #dataengineering #programming
Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.