1. Foreword
With the intensification of the global integration process and China's accession to the WTO, higher demands have been placed on the management of the Chinese government and enterprises. Therefore, making full use of modern information technology, automatically and quickly obtaining useful decision-making information, and providing timely and accurate decision support for enterprises has become the consensus of most successful enterprises and government departments.
Data warehousing is a new database application that has emerged in recent years. The term “data warehouse†first appeared in the early 1990s and is now maturing. According to the IDC survey, the average return on investment (ROI) of data warehouses has exceeded 400%. Data ware technology, like Internet technology, is becoming the fastest IT growth point and is increasingly being combined with smart card application technology.
2. database
The traditional database technology is a single data resource for transaction processing, batch processing, decision analysis and other data processing tasks, mainly divided into two categories: operational processing and analytical processing (or information processing). Operational processing, also called transaction processing, refers to the daily operation of the database connection, usually the query and modification of one or a group of records, mainly for the specific application of the enterprise, focusing on response time, data security and integrity. Analytical processing is used for decision analysis by managers, often accessing large amounts of historical data. The traditional database system is superior to the daily transaction processing of the enterprise, and it is difficult to realize the requirements of data analysis and processing, and it has been unable to meet the requirements of diversification of data processing. The separation of operational processing and analytical processing is inevitable.
With the application and development of database technology, people try to reprocess the data in the database to form a comprehensive, analysis-oriented environment to better support decision analysis, thus forming a data warehouse technology. As a decision support system, the data warehouse system includes:
1) Data warehouse technology;
A data warehouse is a structure that is suitable for the process of knowledge discovery. The process of data warehouse is from the process of "data cleaning / integration -> data warehouse -> data selection -> data mining -> pattern evaluation -> knowledge"
2) Online analytical processing technology;
Online analytical processing is a type of software technology that enables analysts, managers, or executives to access information from multiple perspectives quickly, consistently, and interactively to gain a deeper understanding of the data.
3) Data mining technology;
Extracting from a large amount of incomplete, noisy, fuzzy, random, actual data that is implicit in it, and that is not known beforehand, but is potentially useful information and knowledge. It mines information and discovers knowledge without a clear assumption.
The data warehouse makes up for the shortcomings of the original database, and develops the original data environment centered on a single database into a new environment: a systemized environment.
The concept of data warehousing began in the mid-1980s, and it first appeared in the book "Building Data Warehouses" by William H. Inmon, the father of data warehousing. With the deep understanding and continuous improvement of large-scale data system research, management, maintenance, etc., after summarizing, enriching and concentrating the experience of various industries and enterprise information, a more precise definition is given for the data warehouse, namely “ A data warehouse is a topic-oriented, integrated, time-related, non-modifiable data set in enterprise management and decision making.
The data warehouse does not have a strict mathematical theoretical basis, nor a mature basic model, and is more engineering-oriented, with strong engineering. Therefore, in terms of technology, people are accustomed to analyzing from the work process and other aspects, and are divided into three basic aspects: data extraction, storage and management, and data performance.
1) Data extraction:
The extraction of data is the entry of data into the warehouse. Because the data warehouse is a separate data environment, it needs to import data from the online transaction processing system, external data sources, and offline data storage media to the data warehouse through the extraction process.
2) Storage and management:
The real key to data warehousing is the storage and management of data. The organization and management of the data warehouse determines that it is different from the traditional database, and also determines its representation of external data. To decide which products and technologies to use to build the core of the data warehouse, you need to analyze the technical characteristics of the data warehouse.
3) Performance of the data:
Data performance is actually equivalent to the facade of the data warehouse, and its performance is mainly focused on multidimensional analysis, mathematical statistics and data mining. Multidimensional analysis is an important form of data warehouse. In recent years, due to the development of the Internet, tools and products in the field of multidimensional analysis have paid more attention to providing online front-end analysis interfaces based on the Web, rather than just publishing data on the Internet.
The application of data warehouse technology is very wide. Any data system related to data analysis, report summarization, decision support and so on is the scope of its application.
3. smart card
A smart card is an IC card, which is an integrated circuit card. Its remarkable feature is its embedded integrated circuit chip such as microprocessor and large-capacity memory. IC cards have emerged with the development of semiconductor technology and the increasing demands of society for information security. After decades of development, their technologies have become increasingly mature, and they have been widely used at home and abroad. application. Since IC cards use the most advanced semiconductor manufacturing technology and information security technology, compared with other fixtures, such as magnetic cards, they have the following advantages:
1 Large storage capacity: Because it has an integrated circuit memory chip inside, the storage capacity can reach several megabytes, which is thousands to tens of thousands of times of magnetic cards. The memory of the IC card can be divided into several application areas, which respectively store various information such as text, sound, graphics, images, etc., which is convenient for one card to be used for convenient storage.
2 High security performance: The encryption IC card implements its security policy from several aspects such as hardware and software, and can control the access characteristics of different storage areas in the card. The IC card itself has a secure password, and the information in the card cannot be copied after being encrypted. The card can be read and written only after the password is checked correctly. When the security password is checked incorrectly, the card has a self-destruct function; while the magnetic card can only be encrypted with a weaker software, the stored information can be easily copied. , the security is poor.
3 IC card anti-magnetic, anti-static static, generally can read and write at least 100,000 times, long service life, reliability is higher than magnetic card. And the IC card is small in size, light in weight, easy to carry, and easy to use.
4 IC card reading and writing mechanism is simpler and more reliable than the magnetic card reading and writing mechanism, cheaper to maintain, easy to maintain, easy to promote. It is precisely because of these advantages that IC cards are gaining more and more attention, and their markets are rapidly spreading all over the world, and their application fields have also penetrated from the initial single bank credit card field, including tax collection, payphone, health record, identity authentication, hotel. Tourism and other areas.
The use of IC cards should be said to have a lot of room for expansion. As mentioned above, it is only a part of it. It is widely used. Office automation (OA) systems, attendance systems, and even staff salaries in various industries are available. As an identity authentication, data query and data storage, the IC card truly realizes one card multi-purpose.
China's second-generation ID card, which is about to begin trial use, uses non-contact IC card technology and is the largest IC card application project. Its use will play an important role in strengthening the security and efficiency of China's population informationization.
4. Combination of the two
The smart IC card acts as an interface with the information system, and the generation of a large amount of business data is related to it. Banks, telecommunications, taxation, customs, etc. have accumulated a large amount of data, and business people and decision-makers hope to find useful and valuable information. Under such demand, data warehousing technology has been rapidly promoted in the field of smart card applications.
Take the tobacco industry as an example, a tobacco business information system based on Sybase (US database provider) data warehouse technology. Divided into five versions: National Monopoly Bureau (Tobacco Corporation), Provincial Tobacco Company (Provincial Tobacco Monopoly Bureau), Regional Tobacco Company (Tobacco Monopoly Bureau), also called Tobacco Branch (Subsidiary Tobacco Monopoly Bureau), County Tobacco Company (Tobacco Monopoly Bureau), Tobacco Wholesale Department. The data is vertically distributed and relevant. In order to complete the purchase and sale business, summary processing and query functions.
According to the business characteristics of the tobacco industry, the system is divided into eight subsystems for design: daily business management subsystem, warehouse management subsystem, commodity account accounting subsystem, monopoly management subsystem, price management subsystem, general reporting subsystem, comprehensive query Subsystem, mobile access, distribution, inspection system.
Flexible IC card sales and monopoly management are an important subsystem. When the store is selling, the system records the sales data on the merchant IC card. When the goods are delivered, the cigarettes are sold to the merchants through the mobile IC card reader. The sales records are also recorded in the merchant IC card and IC card reader, and are automatically uploaded to the MIS. The system; the monopoly inspector can also conduct a monopoly check on the merchant through the mobile IC card reader, and the check structure is simultaneously recorded in the merchant IC card and the IC card reader, and automatically uploaded to the MIS system. And extracted to the data warehouse data server for decision support.
The entire system combines the features of a data warehouse and a smart IC card. Fully consider the integration and independence of the system. Implemented some of the following features:
1. Realize data collection
2. Efficient management of IC card monopoly
3. Efficient storage and query
Such a system fully integrates the advantages of both the data warehouse and the smart card, so that the entire system has a complete information process.
China is a country with a large population, and the management of the population has always been highly valued by the state. As an important part of the population systemization, China's first-generation ID card has been unable to meet the needs of the future due to its shortcomings such as poor confidentiality and easy copying. The second-generation ID card that will be replaced will adopt non-contact IC card technology, which will have a qualitative leap in anti-counterfeiting and confidentiality.
The biggest feature of the population information system is the large amount of data, and the annual survey format is different. Take the demographic data of medium-sized cities as an example. Many of the large-scale census sources in the past years are mostly stored in the database in the form of paper media, floppy disks, tapes, etc. These valuable materials face the external environment and the traditional preservation method data. The challenge of security, on the other hand, the business departments and related units also have an urgent need to make full use of data mining. The application of data warehouse is the best solution.
For example, a city with a population of about 9 million, the fourth census data plus nearly ten years of census data, labor situation survey data and community situation survey data, the original data volume is about 10GB. According to the characteristics of the population system, the data warehouse technology was adopted and the best data model and data dictionary were designed for the theme. The compilation of the population data takes a certain amount of time. During the implementation of the project, the data collation work and the data loading work are carried out simultaneously. The 9 million census data and the sample survey data from 1990 to the present have been loaded into the population data warehouse.
The population information data is large, and it has extremely high performance requirements for the data warehouse engine and data loading tools. NCR (as a hardware-based data warehouse solution provider) Its Teradata data warehouse is a completely parallel database, very fast; NCR's FastLoad data loading tool is also parallel, can start multiple session processes, load The 9 million population data takes only 15 minutes, which is unthinkable for other databases.
The application of the population system is characterized by the lack of comparability between the absolute survey indicators of each year. It is necessary to process the original data and derive various relative analytical indicators based on the original data, such as population distribution, age structure, birth structure, and family. Structure, marital status, etc. to meet analytical studies between years. Taking into account the versatility and the convenience of statistical business personnel for analysis, we have designed a universal, powerful and flexible derivative data module that utilizes background processing and Teradata's fast features to generate relatively common derived data from raw data. Derived data has converted the indicator code into Chinese character attributes, and many new attribute fields have been calculated and generated. Based on the derived data, using the reporting tools (such as the Brio tool), the statistical business personnel and the population of the population can be randomly generated. Reports can be used for a variety of online analytical processing which will greatly improve work efficiency. In addition, the second generation ID card adopts non-contact IC card technology, which has strong security and uniqueness. The population information system will be greatly improved in terms of data identification, information interaction and communication speed with the underlying data.
5. Prospects
Data Warehouse Engineering is a complex information integration project that requires careful planning. By planning the data warehouse project, it is necessary to clearly analyze the needs and current situation of the information, and propose how to implement the feasible engineering steps through the adoption of the corresponding technology to achieve the expected goals of the project. With the application of data warehouse technology and smart cards in various industries and enterprises, the combination of the two will also mature. Providing more advanced technical means for the government and enterprise decision-making will further strengthen the management and decision-making functions of the government and enterprises. In the near future, data warehouse technology will play an important role in the construction of information technology in China.
With the intensification of the global integration process and China's accession to the WTO, higher demands have been placed on the management of the Chinese government and enterprises. Therefore, making full use of modern information technology, automatically and quickly obtaining useful decision-making information, and providing timely and accurate decision support for enterprises has become the consensus of most successful enterprises and government departments.
Data warehousing is a new database application that has emerged in recent years. The term “data warehouse†first appeared in the early 1990s and is now maturing. According to the IDC survey, the average return on investment (ROI) of data warehouses has exceeded 400%. Data ware technology, like Internet technology, is becoming the fastest IT growth point and is increasingly being combined with smart card application technology.
2. database
The traditional database technology is a single data resource for transaction processing, batch processing, decision analysis and other data processing tasks, mainly divided into two categories: operational processing and analytical processing (or information processing). Operational processing, also called transaction processing, refers to the daily operation of the database connection, usually the query and modification of one or a group of records, mainly for the specific application of the enterprise, focusing on response time, data security and integrity. Analytical processing is used for decision analysis by managers, often accessing large amounts of historical data. The traditional database system is superior to the daily transaction processing of the enterprise, and it is difficult to realize the requirements of data analysis and processing, and it has been unable to meet the requirements of diversification of data processing. The separation of operational processing and analytical processing is inevitable.
With the application and development of database technology, people try to reprocess the data in the database to form a comprehensive, analysis-oriented environment to better support decision analysis, thus forming a data warehouse technology. As a decision support system, the data warehouse system includes:
1) Data warehouse technology;
A data warehouse is a structure that is suitable for the process of knowledge discovery. The process of data warehouse is from the process of "data cleaning / integration -> data warehouse -> data selection -> data mining -> pattern evaluation -> knowledge"
2) Online analytical processing technology;
Online analytical processing is a type of software technology that enables analysts, managers, or executives to access information from multiple perspectives quickly, consistently, and interactively to gain a deeper understanding of the data.
3) Data mining technology;
Extracting from a large amount of incomplete, noisy, fuzzy, random, actual data that is implicit in it, and that is not known beforehand, but is potentially useful information and knowledge. It mines information and discovers knowledge without a clear assumption.
The data warehouse makes up for the shortcomings of the original database, and develops the original data environment centered on a single database into a new environment: a systemized environment.
The concept of data warehousing began in the mid-1980s, and it first appeared in the book "Building Data Warehouses" by William H. Inmon, the father of data warehousing. With the deep understanding and continuous improvement of large-scale data system research, management, maintenance, etc., after summarizing, enriching and concentrating the experience of various industries and enterprise information, a more precise definition is given for the data warehouse, namely “ A data warehouse is a topic-oriented, integrated, time-related, non-modifiable data set in enterprise management and decision making.
The data warehouse does not have a strict mathematical theoretical basis, nor a mature basic model, and is more engineering-oriented, with strong engineering. Therefore, in terms of technology, people are accustomed to analyzing from the work process and other aspects, and are divided into three basic aspects: data extraction, storage and management, and data performance.
1) Data extraction:
The extraction of data is the entry of data into the warehouse. Because the data warehouse is a separate data environment, it needs to import data from the online transaction processing system, external data sources, and offline data storage media to the data warehouse through the extraction process.
2) Storage and management:
The real key to data warehousing is the storage and management of data. The organization and management of the data warehouse determines that it is different from the traditional database, and also determines its representation of external data. To decide which products and technologies to use to build the core of the data warehouse, you need to analyze the technical characteristics of the data warehouse.
3) Performance of the data:
Data performance is actually equivalent to the facade of the data warehouse, and its performance is mainly focused on multidimensional analysis, mathematical statistics and data mining. Multidimensional analysis is an important form of data warehouse. In recent years, due to the development of the Internet, tools and products in the field of multidimensional analysis have paid more attention to providing online front-end analysis interfaces based on the Web, rather than just publishing data on the Internet.
The application of data warehouse technology is very wide. Any data system related to data analysis, report summarization, decision support and so on is the scope of its application.
3. smart card
A smart card is an IC card, which is an integrated circuit card. Its remarkable feature is its embedded integrated circuit chip such as microprocessor and large-capacity memory. IC cards have emerged with the development of semiconductor technology and the increasing demands of society for information security. After decades of development, their technologies have become increasingly mature, and they have been widely used at home and abroad. application. Since IC cards use the most advanced semiconductor manufacturing technology and information security technology, compared with other fixtures, such as magnetic cards, they have the following advantages:
1 Large storage capacity: Because it has an integrated circuit memory chip inside, the storage capacity can reach several megabytes, which is thousands to tens of thousands of times of magnetic cards. The memory of the IC card can be divided into several application areas, which respectively store various information such as text, sound, graphics, images, etc., which is convenient for one card to be used for convenient storage.
2 High security performance: The encryption IC card implements its security policy from several aspects such as hardware and software, and can control the access characteristics of different storage areas in the card. The IC card itself has a secure password, and the information in the card cannot be copied after being encrypted. The card can be read and written only after the password is checked correctly. When the security password is checked incorrectly, the card has a self-destruct function; while the magnetic card can only be encrypted with a weaker software, the stored information can be easily copied. , the security is poor.
3 IC card anti-magnetic, anti-static static, generally can read and write at least 100,000 times, long service life, reliability is higher than magnetic card. And the IC card is small in size, light in weight, easy to carry, and easy to use.
4 IC card reading and writing mechanism is simpler and more reliable than the magnetic card reading and writing mechanism, cheaper to maintain, easy to maintain, easy to promote. It is precisely because of these advantages that IC cards are gaining more and more attention, and their markets are rapidly spreading all over the world, and their application fields have also penetrated from the initial single bank credit card field, including tax collection, payphone, health record, identity authentication, hotel. Tourism and other areas.
The use of IC cards should be said to have a lot of room for expansion. As mentioned above, it is only a part of it. It is widely used. Office automation (OA) systems, attendance systems, and even staff salaries in various industries are available. As an identity authentication, data query and data storage, the IC card truly realizes one card multi-purpose.
China's second-generation ID card, which is about to begin trial use, uses non-contact IC card technology and is the largest IC card application project. Its use will play an important role in strengthening the security and efficiency of China's population informationization.
4. Combination of the two
The smart IC card acts as an interface with the information system, and the generation of a large amount of business data is related to it. Banks, telecommunications, taxation, customs, etc. have accumulated a large amount of data, and business people and decision-makers hope to find useful and valuable information. Under such demand, data warehousing technology has been rapidly promoted in the field of smart card applications.
Take the tobacco industry as an example, a tobacco business information system based on Sybase (US database provider) data warehouse technology. Divided into five versions: National Monopoly Bureau (Tobacco Corporation), Provincial Tobacco Company (Provincial Tobacco Monopoly Bureau), Regional Tobacco Company (Tobacco Monopoly Bureau), also called Tobacco Branch (Subsidiary Tobacco Monopoly Bureau), County Tobacco Company (Tobacco Monopoly Bureau), Tobacco Wholesale Department. The data is vertically distributed and relevant. In order to complete the purchase and sale business, summary processing and query functions.
According to the business characteristics of the tobacco industry, the system is divided into eight subsystems for design: daily business management subsystem, warehouse management subsystem, commodity account accounting subsystem, monopoly management subsystem, price management subsystem, general reporting subsystem, comprehensive query Subsystem, mobile access, distribution, inspection system.
Flexible IC card sales and monopoly management are an important subsystem. When the store is selling, the system records the sales data on the merchant IC card. When the goods are delivered, the cigarettes are sold to the merchants through the mobile IC card reader. The sales records are also recorded in the merchant IC card and IC card reader, and are automatically uploaded to the MIS. The system; the monopoly inspector can also conduct a monopoly check on the merchant through the mobile IC card reader, and the check structure is simultaneously recorded in the merchant IC card and the IC card reader, and automatically uploaded to the MIS system. And extracted to the data warehouse data server for decision support.
The entire system combines the features of a data warehouse and a smart IC card. Fully consider the integration and independence of the system. Implemented some of the following features:
1. Realize data collection
2. Efficient management of IC card monopoly
3. Efficient storage and query
Such a system fully integrates the advantages of both the data warehouse and the smart card, so that the entire system has a complete information process.
China is a country with a large population, and the management of the population has always been highly valued by the state. As an important part of the population systemization, China's first-generation ID card has been unable to meet the needs of the future due to its shortcomings such as poor confidentiality and easy copying. The second-generation ID card that will be replaced will adopt non-contact IC card technology, which will have a qualitative leap in anti-counterfeiting and confidentiality.
The biggest feature of the population information system is the large amount of data, and the annual survey format is different. Take the demographic data of medium-sized cities as an example. Many of the large-scale census sources in the past years are mostly stored in the database in the form of paper media, floppy disks, tapes, etc. These valuable materials face the external environment and the traditional preservation method data. The challenge of security, on the other hand, the business departments and related units also have an urgent need to make full use of data mining. The application of data warehouse is the best solution.
For example, a city with a population of about 9 million, the fourth census data plus nearly ten years of census data, labor situation survey data and community situation survey data, the original data volume is about 10GB. According to the characteristics of the population system, the data warehouse technology was adopted and the best data model and data dictionary were designed for the theme. The compilation of the population data takes a certain amount of time. During the implementation of the project, the data collation work and the data loading work are carried out simultaneously. The 9 million census data and the sample survey data from 1990 to the present have been loaded into the population data warehouse.
The population information data is large, and it has extremely high performance requirements for the data warehouse engine and data loading tools. NCR (as a hardware-based data warehouse solution provider) Its Teradata data warehouse is a completely parallel database, very fast; NCR's FastLoad data loading tool is also parallel, can start multiple session processes, load The 9 million population data takes only 15 minutes, which is unthinkable for other databases.
The application of the population system is characterized by the lack of comparability between the absolute survey indicators of each year. It is necessary to process the original data and derive various relative analytical indicators based on the original data, such as population distribution, age structure, birth structure, and family. Structure, marital status, etc. to meet analytical studies between years. Taking into account the versatility and the convenience of statistical business personnel for analysis, we have designed a universal, powerful and flexible derivative data module that utilizes background processing and Teradata's fast features to generate relatively common derived data from raw data. Derived data has converted the indicator code into Chinese character attributes, and many new attribute fields have been calculated and generated. Based on the derived data, using the reporting tools (such as the Brio tool), the statistical business personnel and the population of the population can be randomly generated. Reports can be used for a variety of online analytical processing which will greatly improve work efficiency. In addition, the second generation ID card adopts non-contact IC card technology, which has strong security and uniqueness. The population information system will be greatly improved in terms of data identification, information interaction and communication speed with the underlying data.
5. Prospects
Data Warehouse Engineering is a complex information integration project that requires careful planning. By planning the data warehouse project, it is necessary to clearly analyze the needs and current situation of the information, and propose how to implement the feasible engineering steps through the adoption of the corresponding technology to achieve the expected goals of the project. With the application of data warehouse technology and smart cards in various industries and enterprises, the combination of the two will also mature. Providing more advanced technical means for the government and enterprise decision-making will further strengthen the management and decision-making functions of the government and enterprises. In the near future, data warehouse technology will play an important role in the construction of information technology in China.
Many people enjoy drinking coffee every day, but how to pack your high quality coffee is a very important question, firstly you need a good Coffee Bag , just contact us , Sunway can give you excellent solutions.
1.FLexible non-air tight packaging: this is the most economical packaging. It is usually adopted by small local bakeries because they can guarantee quick delivery. Coffee beans can be consumed in time. T he beans in this packaging can only be stored for a short time.
2. Airtight packaging: vacuum and seal the coffee after loading it. Since carbon dioxide is formed during roasting, the packaging can only be packaged after the coffee has been degassed for a period of time, so there are several days between storage. Coffee beans last longer than coffee powder. The cost is low because there is no air separation during storage. This packaging should run out of coffee in 10 weeks.
3. One-way exhaust valve packaging: after baking, coffee is placed in a special one-way exhaust valve with one direction. The exhaust valve allows gas to go out, but not in. Do not needs to store alone stage, but because there is an exhalation process, fragrance can have a little loss. It prevents the formation of putrid odors, but not the loss of aroma.
4. Pressurized packaging: this is the most expensive way to store coffee for two years. Coffee can be vacuumed after a few minutes of roasting. After some inert gas is added, the proper pressure is maintained in the package. The coffee beans are kept under pressure, allowing the aroma to flow through the fat, improving the flavor of the drink.
Coffee Bag
Coffee Bag,Coffee Packaging Bag,Foil Coffee Bags,Resealable Coffee Bags
Shenzhen Sunway Packaging Material Co., Ltd , http://www.sunwaypack.com