Airbyte - ETL ELT Data Pipelines

Understanding OLAP: Online Analytical Processing in Data Engineering | Airbyte https://airbyte.com/data-engineering-resources/olap

How to Create an Airbyte Python Destination: DuckDB https://airbyte.com/tutorials/creating-duckdb-destination-with-python

How to create your own Airbyte connector and pull data from Discord API In this tutorial, we are going to explain how to create an Airbyte source connector for 3 endpoints of the Discord API using Airbyte’s CDK framework. Among the advantages provided by the cdk system we can mention: ▫️Abstract ourselves from the code handling the connection. ▫️A vast number of pre-designed connectors. ▫️A series of tools to create both a source and a destination with ease. https://www.fortisoft.io/how-to-create-your-own-airbyte-connector-and-pull-data-from-discord-api/

Version control Airbyte configurations with Octavia CLI https://airbyte.com/tutorials/version-control-airbyte-configurations

Data Warehouse vs. Operational Database! What? How? Which One? | Airbyte https://airbyte.com/blog/data-warehouse-vs-operational-database

Airbyte - move(data) '22 Видео с конференции https://youtube.com/playlist?list=PLgyvStszwUHjko19Z3PxkBxApbxgVjWp8

Через 30 минут начнётся move data конференция (в 21 по мск) https://movedata.airbyte.com/

Catalog of Data Integration Connectors | Airbyte With over 170+ connectors in our catalog Airbyte is addressing the long tail of connectors so your team doesn’t have to. https://airbyte.com/connectors

The Data Practitioner Conference 7,8 December 2022 move(data) - The data engineering conference 👉 @airbyte https://movedata.airbyte.com/

Automate your Data Scraping with Apache Airflow and Beautiful Soup With this tutorial, learn how to easily automate LinkedIn web scraping 👉 @airbyte https://airbyte.com/tutorials/data-scraping-with-airflow-and-beautiful-soup

https://movedata.airbyte.com/ Есть такие ребята Airbyte (https://airbyte.com), конкуренты Airflow, запускатор по расписанию, опенсорсный бесплатный и платный у них в облаке. Так вот они решили организовать конференцию по Data Engineering. Есть только даты (8-10 Ноября) и ссылка на Slack, программы пока нет. Возможно, будет что-то интересное. А может и нет. Just FYI. P.S. Аудитория подсказывает, что ближайшие конкуренты это Fivetran, Stitch или Hevo. Спасибо @nikbeesti @ohmydataengineer

https://airbyte.com/blog/data-lake-lakehouse-guide-powered-by-table-formats-delta-lake-iceberg-hudi

Airbyte — Promising Integration tool https://medium.com/geekculture/airbyte-promising-integration-tool-6682f34f7711

The Open Source Data Platform - Airbyte In Part 2: We are going to build on top of the best orchestration tool on the market, in my opinion, Prefect; while using Airbyte to perform lifts and shifts of data around our databases to ensure data parity and consistency in our Data Platform. https://kjhealey.medium.com/the-open-source-data-platform-33ff5da0b2db

GitHub - airbytehq/airflow-summit-airbyte-2022: git push your data stack with Airbyte, Airflow, and dbt - 2022 Airflow Summit https://github.com/airbytehq/airflow-summit-airbyte-2022

airflow.providers.airbyte.operators.airbyte — apache-airflow-providers-airbyte Documentation https://airflow.apache.org/docs/apache-airflow-providers-airbyte/2.1.0/_api/airflow/providers/airbyte/operators/airbyte/index.html

Airbyte Open-Source ELT data pipelines. Docker Compose Install https://ivan-shamaev.ru/airbyte-open-source-elt-data-pipelines-docker-compose-install/

Getting Started w/ Airbyte! | Open Source Data Integration Airbyte is a data integration tool like Fivetran or Stitch, but completely open source! In today's video I want to show you how you can easily get started using it. While there are some limitations compared to the other products, in general Airbyte is incredibly powerful and will be sufficient for most use cases. They also have a cloud-hosted option that you can pay for if you don’t want to deal with the hassle of setting it up yourself. But by the end of this video, you'll be able to add this great product to your data engineering toolbox. https://youtu.be/oeshl0H1JcU

https://youtu.be/M3oN7nALq0s

https://airbyte.com/blog/sql-vs-python-data-analysis