 the processing of data where raw data is initially placed and transformed upon being loaded from its source. New data is initially pulled into the Raw data tables within the Staging area, which is the unchanged tables downloaded from each source. Routines are then applied to clean up, format and deduplicate, and derive the required indicators from the raw data. Records are added to the relevant table in the Prepared section of the Staging area, which forms the basis of the warehouse structure. In this way, the main tables are populated; one each for data regarding:  Individuals  Households  Families  Vulnerabilities  Lead Professionals  Addresses  Relationships Receiving Data: Pipelines and Data Sources The TFD consists of data on over 100 indicators, derived from data sourced from both within the council and externally. It therefore needs processes for reading up-to-date information from these sources into the database in a format that is useful. This is accomplished through recurring processes drawing from 34 sources, which create 108 indicators from the council’s own data sources, and the other organisations (including DWP and the NHS) the database draws data from. Each process is tailored to the organisation and database from which data is being drawn, however most fall within two main ways of adding data to the system:  Direct Connections – Credentials are supplied for the server holding the TFD to access the source server and select data from the relevant tables directly. This reduces the need for manual intervention, and along with it the risk of human error, but may be more difficult to set up from an IT and security perspective. Social Finance Limited +44 (0) 20 7770 6836 87 Vauxhall Walk, London SE11 5HJ socialfinance.org.uk 84  Network Drives – Staf