Data Cleansing

From Wikipedia

Data cleansing or data scrubbing is the act of detecting and correcting (or removing) corrupt or inaccurate records from a record set, table, or database. Used mainly in databases, the term refers to identifying incomplete, incorrect, inaccurate, irrelevant etc. parts of the data and then replacing, modifying or deleting this dirty data.

After cleansing, a data set will be consistent with other similar data sets in the system. The inconsistencies detected or removed may have been originally caused by different data dictionary definitions of similar entities in different stores, may have been caused by user entry errors, or may have been corrupted in transmission or storage.

Data cleansing differs from data validation in that validation almost invariably means data is rejected from the system at entry and is performed at entry time, rather than on batches of data.

The actual process of data cleansing may involve removing typos or validating and correcting values against a known list of entities. The validation may be strict (such as rejecting any address that does not have a valid postal code) or fuzzy (such as correcting records that partially match existing, known records).

Accomplishing Data Integrity

Data integrity is elementary concept of information system audit. Data integrity mean data have attribute: correctness, completeness, wholeness, soundness and compliance with the intention of the creators of the data.

Data integrity can be compromised in a number of ways:
# Human errors when inputed data
# Errors that occur when data is transmitted.
# Software bugs
# Data corrupt cause of viruses.
# Hardware damaged, such as disk crashes
# Force majure, such as fires and floods

There are many ways to minimize these threats to data integrity. These include:
# Backing up data periodicly, For example twice a week
# Controlling access to data via security mechanisms
# Designing user interfaces that prevent the input of invalid data
# Using error detection and correction software when transmitting data

Step by step automatic database backup using SQL Server

I would share you information about step by step database backup automaticly using SQL Server :

1. Open SQL Server Enterprice manager
2. Click name of your database (ex : localhost)
3. Click Managament
4. Right click on Database Maintenance Plans. Then choose New Maintenance Plans Menu
5. It will appear new window-form wizard. Follow the instruction then click Next
6. Choose the database which will be backup then click NEXT
7. After Update Data Optimazation Information form appeared (there is nothing to do at this form). You just click NEXT
8. After Database Integrity Check form appeared (there is nothing to do at this form). You just click NEXT
9. After Specify Database Backup Plans form appeared, click CHANGE to arrange schedule of backup process then click NEXT.
10 After Specify Backup Disk Directory form appeared, Specify the directory in wich to store the backup file. then click NEXT.
11. After SpecifyThe Transaktion Log Backup Plans form appeared, check Back up the transaction log as part of maintenance plan if you want to make log , if you dont, ignore this instruction then click NEXT.
13. After that follow the instruction on the form until Completing the Database Maintenance Plan Wizard form appeared then input name of Plan: then Click Finish

NB : you have to switch off SQL Server Agent service before

Quality of Data

From Wikipedia, the free encyclopedia

Data Quality refers to the quality of data. Data are of high quality "if they are fit for their intended uses in operations, decision making and planning" (J.M. Juran). Alternatively, the data are deemed of high quality if they correctly represent the real-world construct to which they refer. These two views can often be in disagreement, even about the same set of data used for the same purpose.

1. Data Quality refers to the degree of excellence exhibited by the data in relation to the portrayal of the actual phenomena. GIS Glossary

2. The state of completeness, validity, consistency, timeliness and accuracy that makes data appropriate for a specific use. Government of British Columbia

3. The totality of features and characteristics of data that bears on their ability to satisfy a given purpose; the sum of the degrees of excellence for factors related to data.

Contact Us

Informasi lebih lanjut, dapat menghubungi Express Team – Data Solution Partners
Phone : 021-96659274
Mobile : 0818-07925023
Email : adek_apohan@baby-brilliant.com

Experiences

�� BPPK Dep-Keu,BPKP,DirJen Pajak, Bank Indonesia
�� BPD JABAR, Bank BTN, Bank Bumiputera, KAP/Consulting
�� PT PLN Persero ,PT. JAMSOSTEK, PT Asuransi Jasa Tania
�� PT Infomedia Nusantara, PT.PERTAMEDIKA, MOBILE 8
�� Dan lain-lain

Services

PELATIHAN TEKNIK ANALISA & PEMERIKSAAN DATA BERBASIS KOMPUTER
Durasi : 4 (Empat) hari
Jam pelatihan : - 09:00 s/d 16:00 WIB
Peserta : Maximal 10 Orang (Paket)
Tempat : Ditanggung oleh Peserta
Biaya : Disesuaikan
Peralatan : Ditanggung oleh Peserta
Metode : - Teori dan Praktek
- Diskusi
- Studi kasus (Bahasa Indonesia)
Silabus Pelatihan antara lain :
• Memahami secara mendasar tentang data
• Mengakses Data
• Memahami ruang lingkup ACL for Windows
• Meng-Identifikasi Duplikasi, Pengecualian dan
Keganjilan Data
• Membuat Kondisi-Kondisi pada Data
• Membuat dan Menggabungkan data (Multifile)
• Mengenal Script di ACL Software
Note : per-Orangan jika tidak mencukupi pesertanya

PENDAMPINGAN (IMPLEMENTASI & SUPPORT)

Tujuannya mempercepat proses “transfer knowledge” dan prakatek kerja dengan menggunakan data asli (real data). Guna mendukung tercapainya penggunaan ACL
Software dalam meningkatkan kinerja Analyst Data.
Nama Projek : Pendampingan (Implementation & Supports)
ACL Software Tools
Durasi : Disesuaikan / Hari
Biaya : Disesuaikan / Hari
Metode : - Praktek
- Diskusi

DATA PROCESSING SUPPORT

Dalam pengolahan data ini Express Team – Data Solution Partners melakukan proses Data Access (Direct maupun un-Direct), Verifikasi data dari hasil Data Access “apakah ada kesalahan dalam mengakses data?”, mengAnalisa Data yang sesuai dengan permintaan (Request) dan Data Laporan semua data hasil dari proses diatas. Data diproses dengan menggunakan semua data(100%) tanpa metode sampling.

We are providing diverse range of data processing services like:
- Data Entry Services
- Image PDF Processing And OCR
- Forms Processing Services
- Offering services of data entry works, forms processing services, data indexing services, optical character recognition services, data capture services and image pdf processing services.
- Fast, accurate, economical data conversion and transcription of paper, digital data into XML, HTML, PDF and all other digital formats.
- Migrate Data from/to PL/SQL, SQL Server, Sybase, MySQL databases and etc

BACKGROUND

Seiring dengan perkembangan teknologi komputer sebagai media media penyimpanan data, semakin diperlukan pula bagi seorang Analis atau individu yang biasa bergelut dengan data mempunyai kemampuan / mampu dalam mengolah data secara tepat, cepat dan akurat. Saat ini masih banyak para analis yang masih menggunakan metode lama (sampling data) dalam memeriksa/mengawasi/mengkonversi data-data, dengan alasan, waktu yang diberikan untuk memeriksa/mengawasi/mengkonversi tidak mencukupi.

Akibatnya, hasil yang didapat pun tidak selalu maksimal. Kendala lain adalah pemahaman yang kurang tentang pemrograman komputer. Dalam hal ini Express Team sebagai Data Solution Partners merasa terpanggil untuk memberikas solusi cepat dan akurat akan semua permasalah yang Anda alami mengenai Data dengan dibantu sebuah aplikasi komputer. Kami dapat membantu untuk melakukan proses verifikasi hasil dari data yang diperoleh untuk menciptakan integrasi data yang dipercaya dan hasil analisa data yang dapat dihandalkan. Semua dapat dilakukan dengan cepat, tepat, aman dan akurat.