Dl/DataApplication
From stonehomewiki
Revision as of 00:48, 7 March 2023 by
Stonezhong
(
talk
|
contribs
)
(
diff
)
← Older revision
|
Latest revision
(
diff
) |
Newer revision →
(
diff
)
Jump to navigation
Jump to search
Data Application: for data ingestion
An application that generates dataframes and update dataset.
Data Application: for data transformation
Consume one or multiple dataset and generates dataframes and update datasets
Data Pipeline
Bunch of data application that has dependency
Runs on a regular basis
It is a good idea to using Apache Airflow to orchestrate data pipeline
Navigation menu
Page actions
Page
Discussion
Read
View source
History
Page actions
Page
Discussion
More
Tools
Personal tools
Log in
Navigation
Data Lake
Firebird
Main page
Recent changes
Random page
Help about MediaWiki
Search
Tools
What links here
Related changes
Special pages
Printable version
Permanent link
Page information