{"id":6451,"date":"2017-12-10T17:42:08","date_gmt":"2017-12-10T22:42:08","guid":{"rendered":"https:\/\/www.jitendrazaa.com\/blog\/?p=6451"},"modified":"2018-04-16T19:12:12","modified_gmt":"2018-04-16T23:12:12","slug":"definition-of-frequently-used-database-architecture-related-terms","status":"publish","type":"post","link":"https:\/\/www.jitendrazaa.com\/blog\/others\/definition-of-frequently-used-database-architecture-related-terms\/","title":{"rendered":"Definition of Frequently Used Database Architecture Related Terms"},"content":{"rendered":"<ol>\n<li><strong>Data Warehouse<\/strong><\/li>\n<\/ol>\n<p style=\"text-align: justify;\">Data warehouse is also known as\u00a0<strong>Enterprise Data Warehouse (EDW).\u00a0<\/strong>Data warehouse is used as source for Business Intelligent&#8217;s reporting and analysis. Data Warehouse system collects data from multiple sources and contains historical data for trend analysis reporting.\u00a0<strong>ETL\u00a0<\/strong>tool is used mostly to build\u00a0<strong>Data Warehouse\u00a0<\/strong>and interfaces around it. Data Warehouse acts as\u00a0<strong>Single Version of truth.<\/strong><\/p>\n<figure id=\"attachment_6452\" aria-describedby=\"caption-attachment-6452\" style=\"width: 360px\" class=\"wp-caption aligncenter\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-6452\" src=\"https:\/\/i0.wp.com\/www.jitendrazaa.com\/blog\/wp-content\/uploads\/2018\/04\/Data_warehouse_overview.jpg?resize=360%2C270&#038;ssl=1\" alt=\"Data warehouse overview (From Wikipedia)\" width=\"360\" height=\"270\" srcset=\"https:\/\/i0.wp.com\/www.jitendrazaa.com\/blog\/wp-content\/uploads\/2018\/04\/Data_warehouse_overview.jpg?w=360&amp;ssl=1 360w, https:\/\/i0.wp.com\/www.jitendrazaa.com\/blog\/wp-content\/uploads\/2018\/04\/Data_warehouse_overview.jpg?resize=300%2C225&amp;ssl=1 300w\" sizes=\"auto, (max-width: 360px) 100vw, 360px\" \/><figcaption id=\"caption-attachment-6452\" class=\"wp-caption-text\">Data warehouse overview (From Wikipedia)<\/figcaption><\/figure>\n<p><strong>2. Operational Data Store (ODS)<\/strong><\/p>\n<p style=\"text-align: justify;\">Operational Data Store is frequently confused and definition is overlapped with Data Warehouse. Some of my clients had used word ODS instead of Data Warehouse, which got me confused on number of occasion. As per my understanding &amp; research, ODS is used to integrate data from multiple systems and feed it to Data Warehouse. Data Warehouse consist of complete history of data, whereas ODS contains latest or recent data (short window of data). Data load frequency in ODS is mostly hourly whereas data load frequency in Data Warehouse mostly is nightly because of data volume. Most important reason to have ODS in your company is ability to run report realtime, where source system does not have required reporting capabilities.<\/p>\n<p><strong>3. Data Mart<\/strong><\/p>\n<p style=\"text-align: justify;\">Data warehouse can contain many Data Marts. Mostly Data mart is created per business line or system that needs data from Data Warehouse. Indirectly we can say, Data Mart is access layer used to get data out of Data Warehouse by other systems.<\/p>\n<p><strong>4. Data Lake<\/strong><\/p>\n<p style=\"text-align: justify;\">Term Data Lake was coined by James Dixon, CTO of Pentaho to compare with Data Mart. As per James, Data Mart have several problems mostly related to data silos. Data Lake is method of storing data from sources in its actual or raw format that could be Relational Data, XML, flat files or even binary files. Other tools like ETL, access Data Lake as per need for reporting or analysis purposes.<\/p>\n<p><strong>Resources<\/strong><\/p>\n<ul>\n<li>Data Warehouse on <a href=\"https:\/\/en.wikipedia.org\/wiki\/Data_warehouse\">Wikipedia<\/a><\/li>\n<li><a href=\"http:\/\/www.jamesserra.com\/archive\/2015\/02\/operational-data-store-ods-defined\/\">Operational Data Store\u00a0<\/a><\/li>\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Data_mart\">Data Mart<\/a><\/li>\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Data_lake\">Data Lake<\/a><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Definitions of Data warehouse, Data lake, Data Mart, Operational Data Store<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"advanced_seo_description":"","jetpack_seo_html_title":"","jetpack_seo_noindex":false,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"jz_research_post":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[6],"tags":[344,70,91],"class_list":["post-6451","post","type-post","status-publish","format-standard","hentry","category-others","tag-architect","tag-database","tag-etl"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":2320,"url":"https:\/\/www.jitendrazaa.com\/blog\/others\/rtm-nu\/be-8th-sem-cse-syllabus-of-rtm-nagpur-university\/","url_meta":{"origin":6451,"position":0},"title":"BE 8th sem CSE syllabus of RTM Nagpur University","author":"Jitendra","date":"August 3, 2011","format":false,"excerpt":"BE 8th sem CSE syllabus of RTM Nagpur University","rel":"","context":"In &quot;RTM NU&quot;","block_context":{"text":"RTM NU","link":"https:\/\/www.jitendrazaa.com\/blog\/category\/others\/rtm-nu\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1359,"url":"https:\/\/www.jitendrazaa.com\/blog\/sql\/sqlserverintegrationservices\/etl-dts-and-ssis-introduction\/","url_meta":{"origin":6451,"position":1},"title":"ETL , DTS and SSIS Introduction","author":"Jitendra","date":"December 4, 2010","format":false,"excerpt":"Introduction to ETL Services, Data transformation services, SQL Server Integration Services, Advantages of SSIS over DTS, New features of SSIS 2008","rel":"","context":"In &quot;SSIS&quot;","block_context":{"text":"SSIS","link":"https:\/\/www.jitendrazaa.com\/blog\/category\/sql\/sqlserverintegrationservices\/"},"img":{"alt_text":"What is ETL Extraction Transformation Loading","src":"https:\/\/i0.wp.com\/jitendrazaa.com\/blog\/wp-content\/uploads\/2010\/12\/What-is-ETL-Extraction-Transformation-Loading.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":5094,"url":"https:\/\/www.jitendrazaa.com\/blog\/salesforce\/10-salesforce-integration-design-considerations-from-architect-point-of-view-mind-mapping-included\/","url_meta":{"origin":6451,"position":2},"title":"10 Salesforce Integration design considerations from Architect point of view &#8211; Mind Mapping included","author":"Jitendra","date":"December 21, 2015","format":false,"excerpt":"After working on multiple Salesforce implementation project as an Architect, its time to share\u00a0what I learned from those implementations and would strongly suggest to be considered before designing any \"Salesforce Integration\". Below image shows \"integration mind mapping\" used by me. I use it to consider some major aspects\u00a0while discussing integration\u2026","rel":"","context":"In &quot;Salesforce&quot;","block_context":{"text":"Salesforce","link":"https:\/\/www.jitendrazaa.com\/blog\/category\/salesforce\/"},"img":{"alt_text":"Salesforce Integration Mind mapping diagram","src":"https:\/\/i0.wp.com\/www.jitendrazaa.com\/blog\/wp-content\/uploads\/2015\/12\/Salesforce-Integration-Mind-mapping-diagram.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.jitendrazaa.com\/blog\/wp-content\/uploads\/2015\/12\/Salesforce-Integration-Mind-mapping-diagram.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.jitendrazaa.com\/blog\/wp-content\/uploads\/2015\/12\/Salesforce-Integration-Mind-mapping-diagram.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/www.jitendrazaa.com\/blog\/wp-content\/uploads\/2015\/12\/Salesforce-Integration-Mind-mapping-diagram.png?resize=700%2C400&ssl=1 2x"},"classes":[]},{"id":1619,"url":"https:\/\/www.jitendrazaa.com\/blog\/sql\/sqlserverintegrationservices\/merge-two-data-in-etl-project-of-ssis\/","url_meta":{"origin":6451,"position":3},"title":"Merge Two Data in ETL project of SSIS","author":"Jitendra","date":"March 10, 2011","format":false,"excerpt":"Example of Merging two data in ETL project of SSIS","rel":"","context":"In &quot;SSIS&quot;","block_context":{"text":"SSIS","link":"https:\/\/www.jitendrazaa.com\/blog\/category\/sql\/sqlserverintegrationservices\/"},"img":{"alt_text":"Merge Two Data in ETL project of SSIS","src":"https:\/\/i0.wp.com\/jitendrazaa.com\/blog\/wp-content\/uploads\/2011\/03\/Merge-Two-Data-in-ETL-project-of-SSIS.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":1591,"url":"https:\/\/www.jitendrazaa.com\/blog\/sql\/sqlserverintegrationservices\/create-simple-etl-project-in-ssis-filter-records\/","url_meta":{"origin":6451,"position":4},"title":"Create Simple ETL Project in SSIS &#8211; Filter Records","author":"Jitendra","date":"February 28, 2011","format":false,"excerpt":"Creating First ETL (Extract, Transform and Load) project in SSIS (SQL Server Integration Services) - Filter Records","rel":"","context":"In &quot;SSIS&quot;","block_context":{"text":"SSIS","link":"https:\/\/www.jitendrazaa.com\/blog\/category\/sql\/sqlserverintegrationservices\/"},"img":{"alt_text":"Create Business Intelligence Projects in Visual Studio","src":"https:\/\/i0.wp.com\/jitendrazaa.com\/blog\/wp-content\/uploads\/2011\/02\/New-Business-Intelligence-Projects.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":11235,"url":"https:\/\/www.jitendrazaa.com\/blog\/salesforce\/talk-to-salesforce-data-using-openai-langchain-chroma\/","url_meta":{"origin":6451,"position":5},"title":"Talk to Salesforce Data Using OpenAI, Langchain &#038; Chroma","author":"Jitendra","date":"December 14, 2023","format":false,"excerpt":"Discover how to leverage OpenAI's powerful embedding capabilities to transform your Salesforce data into insightful, actionable embeddings. This guide provides a step-by-step process, complete with code, to seamlessly integrate Salesforce data with OpenAI's advanced AI models, unlocking new dimensions of data analysis and decision-making. It uses Langchain and Chroma vector\u2026","rel":"","context":"In &quot;Salesforce&quot;","block_context":{"text":"Salesforce","link":"https:\/\/www.jitendrazaa.com\/blog\/category\/salesforce\/"},"img":{"alt_text":"Salesforce Langchain Python OpenAI AWS Lambda2","src":"https:\/\/i0.wp.com\/www.jitendrazaa.com\/blog\/wp-content\/uploads\/2023\/12\/Salesforce-Langchain-Python-OpenAI-AWS-Lambda2.png?fit=1120%2C630&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.jitendrazaa.com\/blog\/wp-content\/uploads\/2023\/12\/Salesforce-Langchain-Python-OpenAI-AWS-Lambda2.png?fit=1120%2C630&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.jitendrazaa.com\/blog\/wp-content\/uploads\/2023\/12\/Salesforce-Langchain-Python-OpenAI-AWS-Lambda2.png?fit=1120%2C630&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.jitendrazaa.com\/blog\/wp-content\/uploads\/2023\/12\/Salesforce-Langchain-Python-OpenAI-AWS-Lambda2.png?fit=1120%2C630&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.jitendrazaa.com\/blog\/wp-content\/uploads\/2023\/12\/Salesforce-Langchain-Python-OpenAI-AWS-Lambda2.png?fit=1120%2C630&ssl=1&resize=1050%2C600 3x"},"classes":[]}],"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/www.jitendrazaa.com\/blog\/wp-json\/wp\/v2\/posts\/6451","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.jitendrazaa.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.jitendrazaa.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.jitendrazaa.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.jitendrazaa.com\/blog\/wp-json\/wp\/v2\/comments?post=6451"}],"version-history":[{"count":1,"href":"https:\/\/www.jitendrazaa.com\/blog\/wp-json\/wp\/v2\/posts\/6451\/revisions"}],"predecessor-version":[{"id":6453,"href":"https:\/\/www.jitendrazaa.com\/blog\/wp-json\/wp\/v2\/posts\/6451\/revisions\/6453"}],"wp:attachment":[{"href":"https:\/\/www.jitendrazaa.com\/blog\/wp-json\/wp\/v2\/media?parent=6451"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.jitendrazaa.com\/blog\/wp-json\/wp\/v2\/categories?post=6451"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.jitendrazaa.com\/blog\/wp-json\/wp\/v2\/tags?post=6451"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}