Data Collection, Storage, And Pre-Processing In Research

Identifying Suitable Data Sources

For any given research it is important to have the necessary data requirements so as to make sure that the experiment is undertaken successful. Consequently, prior to commencing on the experiment, the researcher is supposed to determine and identify suitable sources of data that the research will gather the needed information (Barker, and Milivojevich, 2016). Accordingly, data collection is the initial step when it comes to designing as well as implementing any given experiment. Certainly, after identifying the appropriate sources of data the researcher is supposed to gather raw data and then recorded it in well-organised tables for purposes of analysis at the time of implementing the experiment (Curtis et al, 2015, p. 3462). In this sense there are various steps that are undertaken in at the time of data gathering such as identifying the most suitable data sources, data collection and storage of the collected data.         

Save Time On Research and Writing
Hire a Pro to Write You a 100% Plagiarism-Free Paper.
Get My Paper

Accordingly, the initial step in any given research experiment, the primary most step is identification of appropriate sources of the data under investigation (Eyring et al, 2016, p. 1939). Therefore, it is highly advisable that the researcher determine the most appropriate type of data which is necessary for the experiment to avoid cases of collecting data which is not relevant with the research under investigation (Montgomery, 2017). Therefore, the type of data that will be collected will be used to show how business organisation utilise shopping apps to market and sale their products. The reason of picking of business organisation to be able to identify how these organisations work to ensure that customer’s personal information is protected.  Thus, it is significant for the researcher to select on the most suitable and dependable sources of data where it will be possible to interact with diverse personalities using different social applications to improve their personal data privacy (Candioti, De Zan, Cámara, and Goicoechea, 2014. p. 124). Certainly, some of the probable public place sources that are likely to provide the investigator with the appropriate data include malls, companies and small and medium-sized enterprises and supermarkets which run their business using social applications to interact with their existing and potential customers.          

Table 1: Data collection table  

Data source organisation

Nature of source organisation (Mall, companies, supermarkets, SMEs)

Save Time On Research and Writing
Hire a Pro to Write You a 100% Plagiarism-Free Paper.
Get My Paper

Data description

Data file format

Charge fee

Target data source

Data 1

Public

The population of individuals in possession of smartphones

Txt

Free

Yes

Data 2

Public

The number of individuals who are aware of shopping applications in their smartphones  

Text

Free

Yes

Data 3

Public

The number of people who have downloaded the shopping apps

Text

Free

Yes

Data 4

Public

The number of individuals who follow the shopping applications

Text

Free

Yes

Data 5

Public

Individuals who feel the shopping apps are effective

Text

Free

Yes

Data 6

Public

The number of people satisfied with the shopping apps

Text

Free

Yes

After the data has been gathered and recorded in the acceptable way, the researchers is supposed to keep the gathered raw data in the most appropriate manner because this data will be needed in future. Therefore, some of the appropriate ways to keep this data is through the use of table which have to be saved and kept safe to ensure that these data is not interfered with or accessed by unauthorised persons who might corrupt it (Campbell, and Stanley, 2015). The raw data can be stored in the table as illustrated below.

Table 2: Data storage table  

 Source of Data

Time of data  collection

Format of stored file location

Name of stored file

Format of the stored file

Aggregate number of records

Analysis from business malls

1/8/2018

raw data

Survey1.txt

text

200

Analysis from public places

2/8/2018

raw data

Survey2.txt

text

250

Analysis from companies

3/8/2018

raw data

Survey3.txt

text

150

Analysis from supermarkets

4/8/2018

raw data

Survey 4.txt

text

100

When the data collection has been accomplished and the data safely stored, the following crucial step in the experiment is the design and implementation phase. During the design and implementation where the gathered data is modified as needed to ensure that it is possible to effectively utilise the data in the experiment (Chandrasekaran et al., 2017). As a result, this part involve a number of practices such as data pre-processing feature selection or dimension reduction, experimental design, and lastly but not least real time implementation of the experiment.       

Gathering Raw Data

During the data processing time the collected data is transformed and refined and then converted into more simplified form which are easy to understand and analyse. It can be said that the data pre-processing is conducted to aid the researcher in preparing the data to be utilised in the experiment so that it can realise all the necessary features which have to be processed while analysing the experiment. Accordingly, data pre-processing is an essential procedure in an experiment since it plays a significant part in enhancing the usability and readability of the collected raw data. Consequently, once the experimental raw data has been collected, it is advisable to perform data pre-processing prior to making use of the experiment. In that case, there are several approaches utilised to perform data pre-processing, but the most appropriate approaches include data integration, data cleaning, data reduction, and data transformation.

Data integration: This is a pre-processing approach whereby the collected raw data is improved and then changed into a suitable form or formats accordingly. Therefore, the main practices during this phase include smoothing of data, data normalisation, summing up of the data, as well as data generalisation.

Data cleaning: This is a pre-processing technique that involves normalisation of the data to substitute for some of the erroneous data values, reduction of the data noise and eliminating of the unnecessary inconsistency made during data coaction time. Certainly, data cleaning helps to ensure that the researcher come up with data which is less noisy, complete, and consistent. As a result, this makes it easier for the researcher to analyse the experimental results.     

Data reduction: Accordingly, this process entails simplifying the data by eliminating unnecessary and unwanted data while ensuring that the data is not altered so as not to compromise the quality and integrity of the data. Data reduction involves a range of techniques such as data discretisation, dimension reduction, data compression, and numerosity reduction. Indeed, all this approaches are significant in the sense that they aid to eliminate unwanted and unnecessary data contained in the raw collected data. As a result, it help to ensuring that the researcher only remain with accurate data which can be effectively used in the experimental process with much easy.            

Data transformation: It is pre-processing technique that combine data that seem to be related even though it can be originating from different sources so as to come up with a single and much dependable data that can be utilised as one in the experiment. Thus it makes the experiment process easier.

Accordingly, the figure below provides an illustration of a summary of the major data pre-processing techniques used in experiments.  

Feature selection is a technique used to eliminate certain features contained in the collected raw data to ensure that the researcher get the most appropriate features and highly dependable features (Zhou, Lu, and Fujita, 2015, p. 53). Thus, this make it easy for the researcher to use these features in the experiment. Accordingly feature selection aid in averting encountering with unnecessary data when analysing the data to ensure that the experiment is highly dependable. At times feature selection includes reducing the dimensions of the raw data which is the reason as to why it is at times referred to as dimension reduction (Prusa, Khoshgoftaar, and Dittman, 2015, p. 300). After the feature selection process of data pre-processing and dimension reduction have been carried out the data can be recorded as illustrated in the table below.

Recording Data in Organised Tables

Table 3: Feature selection/dimension reduction table    

Data selection date

Name of data source

Aim of pre-processing

Pre-processing methodology

Original data records

Resulting data records

The new data file name

15/7/2018

Data 1

Removing inconsistency

Data cleaning

150

140

Finalsurvey1.txt

15/7/2018

Data 2

Filling of missing values

Data cleaning

130

108

Finalsurvey2.txt

15/7/2018

Data 3

Removing unnecessary features

Feature selection

170

140

Finalsurvey3.txt

15/7/2018

Data 4

Removing redundancy

Data reduction

200

185

Finalsurvey4.txt

15/7/2018

Data 5

Combining related data

Data integration

250

248

Finalsurvey5.txt

15/7/2018

Data 6

Transforming the data into the required formats

Data transformation

180

175

Finalsurvey6.txt

During the experiment design phase it when the methodology is employed is selected and then applied effectively to the experiment. Thus, it is significant to select a methodology that will ensure that the experiment is performed in a smooth way with no difficulty.  

In the context of this experiment design the research chose on a hybrid methodology. The hybrid method is significant since it allow the investigator to gather and analyse both arithmetical and non-arithmetic data types. Therefore, it was one of the most effective approach for this experiment because the researcher anticipated coming across both arithmetical and non-arithmetic data (Haley et al., 2018, p. 4). The researcher was mainly interested in how shopping apps aided in enhancing the sales of business and how it effectively met customers’ needs and wants. As a result, the researcher paid visits to different public places where they could come into contact with this information. Consequently, the researcher developed some guiding research questions in form of a questionnaires. This questionnaire comprised of various levels such as the level of education, sex, age and background of the participants. Also, another section included how the participants utilised shopping apps in their smartphones. The researcher used both closed-ended questions and open-ended questions to allow participants to give their opinions regarding their experience with the shopping apps. For purposes of ethical considerations the research observed high ethical standards by ensuring that the questions asked could not infringed the respondent’s personal questions. Therefore, the research utilised statistical figures to record and analyse the collected data from the participants which are illustrated in the table below.

Table 4: The questionnaire questions table 

Question #

Question Description

1

Do you have a smartphone?

2

Are you aware of the shopping apps available on your smartphone?

3

Have you download the shopping apps on your smartphone?

4

Do you use shopping apps to make your purchases?

5

Are shopping apps effective in improving your purchasing trends?

6

Are you contented with the performance of the shopping apps?

 What is your view regarding on the improvement that should done on the shopping apps to make them better? Give your recommendation.  

  1. What are some of the challenges or problems that you face when using shopping apps to make your purchases?  What is your suggestions to better the shopping apps?

Certainly after developing the questionnaire, the investigator created a different table which was used to classify the participants based on their age, sex, education level and background. Indeed, classifying these participants was mandatory to allow the researcher to understand how shopping apps were utilised and how frequent this apps were used by diverse demographic data.

Sex

Male

Female

Age range

18 – 25years

26 – 35 years

36 -60 years

Above 60 years

Education level

High school

College diploma

University degree

Masters

Background

Student

Business person

Employed

Unemployed

After developing the research questions and classifying the demographic population information of the respondents, the investigator went head to collect the data as asked by the experiment. The gathered data was then analysed with the help of certain statistical analysis techniques and tools with Microsoft Excel being the chief software for analysing data.

The table blow shows the analysed demographic population information for individuals who were involved in the research.

Table 6: Analysed demographic population information 

Demographic population information

Responses N (%) 

Sex

Male

Female

125(50%)

125 (50%)

Age range

18 – 25years

26 – 35 years

36 -60 years

Above 60 years                                          

50 (20%)

90 (36%)

70 (28%)

40 (16%)

Education level

High school

College

University

Masters

30 (12%)

100 (40%)

80 (32%)

40(16%)

Background

Student

Business persons

Employed

Unemployed

45 (18%)

125 (50%)

30 (12%)

50 (20%)

 The total number of respondents used in the research was 250   

The target research population used in this case involved 250 participants. The results that after circulating the questionnaire to be filled in by respondents’ involved 250 respondents is lustrated in the table below.

Information associated with the shopping apps

Responses (%)

The number of respondents who possess smartphones

245 (98%)

The number of respondents aware of the shopping apps on their smartphones

230 (92%)

The number of respondents who have downloaded the shopping apps

200 (80%)

The number of respondents who follow the shopping apps after downloading them

189 (75.6%)

The number of respondents who feel the shopping apps are effective in improving their purchasing experience

150 (60%)

The number of respondents who are satisfied with the performance of the shopping apps

170 (68%)

The number of respondents that recommend improvement on the shopping apps

80 (32%)

The number of respondents who have experienced problems with the shopping apps

15 (6%)

Prior to conducting any research the investigator is supposed to have an anticipation regarding the likely research outcome. Accordingly, prior information regarding the research experiment plays a significant role in aiding the investigator to work within the experiment scope and avoid straying of the experiment. It also, make it easier to find know what is expected of the experiment. Therefore, to get the expected idea regarding the study is found from past research on a similar research subject literature which the researcher intent to expound their understanding. Thus, before performing the research the researcher is required to ensure that there is a sufficient number of people using smartphones and they are also aware of the existence of the shopping apps in their cell phones. Also, some of the individuals should be already using shopping apps to make purchases to enhance their purchasing experience.         

The anticipated results was not far much from the real time experimental outcomes that were attained after performing the research. After undertaking the research the researcher found the following results:

Out of the 250 participants 245 participants were in possession of smartphones with shopping apps.

92% of the respondents were conversant with the shopping apps on their smartphones.

Among the research sample 75.6% had already downloaded the shopping apps and using them.

60% of the respondents who took part in the research found that shopping apps were effective and enhancing their purchasing experience.

68% of the respondents were satisfied with the performance of the shopping apps in making purchases.

Out of the 250 participants only 32% gave a recommendation regarding improvement on the shopping mall.

Lastly, only 6% of the respondents experienced challenges with using the shopping apps, which means that the shopping apps were highly effective in making purchases. 

Barker, T.B. and Milivojevich, A., 2016. Quality by experimental design. CRC Press.

Barker, T.B. and Milivojevich, A., 2016. Quality by experimental design. CRC Press.

Campbell, D.T. and Stanley, J.C., 2015. Experimental and quasi-experimental designs for research. Ravenio Books.

Candioti, L.V., De Zan, M.M., Cámara, M.S. and Goicoechea, H.C., 2014. Experimental design and multiple response optimization. Using the desirability function in analytical methods development. Talanta, 124, pp.123-138.

Chandrasekaran, A., Anand, G., Ward, P., Sharma, L. and Moffatt-Bruce, S., 2017. Design and Implementation of Standard Work on Care Delivery Performance: A Quasi-Experimental Investigation.

Curtis, M.J., Bond, R.A., Spina, D., Ahluwalia, A., Alexander, S.P., Giembycz, M.A., Gilchrist, A., Hoyer, D., Insel, P.A., Izzo, A.A. and Lawrence, A.J., 2015. Experimental design and analysis and their reporting: new guidance for publication in BJP. British journal of pharmacology, 172(14), pp.3461-3471.

Eyring, V., Bony, S., Meehl, G.A., Senior, C.A., Stevens, B., Stouffer, R.J. and Taylor, K.E., 2016. Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization. Geoscientific Model Development, 9(5), pp.1937-1958.

Haley, N.J., Richt, J.A., Davenport, K.A., Henderson, D.M., Hoover, E.A., Manca, M., Caughey, B., Marthaler, D., Bartz, J. and Gilch, S., 2018. Design, implementation, and interpretation of amplification studies for prion detection. Prion, pp.1-10.

Merriam, S.B. and Tisdell, E.J., 2015. Qualitative research: A guide to design and implementation. John Wiley & Sons.

Montgomery, D.C., 2017. Design and analysis of experiments. John wiley & sons.

Prusa, J.D., Khoshgoftaar, T.M. and Dittman, D.J., 2015, May. Impact of Feature Selection Techniques for Tweet Sentiment Classification. In FLAIRS Conference (pp. 299-304).

Zhou, L., Lu, D. and Fujita, H., 2015. The performance of corporate financial distress prediction models with features selection guided by domain knowledge and data mining approaches. Knowledge-Based Systems, 85, pp.52-61.

What Will You Get?

We provide professional writing services to help you score straight A’s by submitting custom written assignments that mirror your guidelines.

Premium Quality

Get result-oriented writing and never worry about grades anymore. We follow the highest quality standards to make sure that you get perfect assignments.

Experienced Writers

Our writers have experience in dealing with papers of every educational level. You can surely rely on the expertise of our qualified professionals.

On-Time Delivery

Your deadline is our threshold for success and we take it very seriously. We make sure you receive your papers before your predefined time.

24/7 Customer Support

Someone from our customer support team is always here to respond to your questions. So, hit us up if you have got any ambiguity or concern.

Complete Confidentiality

Sit back and relax while we help you out with writing your papers. We have an ultimate policy for keeping your personal and order-related details a secret.

Authentic Sources

We assure you that your document will be thoroughly checked for plagiarism and grammatical errors as we use highly authentic and licit sources.

Moneyback Guarantee

Still reluctant about placing an order? Our 100% Moneyback Guarantee backs you up on rare occasions where you aren’t satisfied with the writing.

Order Tracking

You don’t have to wait for an update for hours; you can track the progress of your order any time you want. We share the status after each step.

image

Areas of Expertise

Although you can leverage our expertise for any writing task, we have a knack for creating flawless papers for the following document types.

Areas of Expertise

Although you can leverage our expertise for any writing task, we have a knack for creating flawless papers for the following document types.

image

Trusted Partner of 9650+ Students for Writing

From brainstorming your paper's outline to perfecting its grammar, we perform every step carefully to make your paper worthy of A grade.

Preferred Writer

Hire your preferred writer anytime. Simply specify if you want your preferred expert to write your paper and we’ll make that happen.

Grammar Check Report

Get an elaborate and authentic grammar check report with your work to have the grammar goodness sealed in your document.

One Page Summary

You can purchase this feature if you want our writers to sum up your paper in the form of a concise and well-articulated summary.

Plagiarism Report

You don’t have to worry about plagiarism anymore. Get a plagiarism report to certify the uniqueness of your work.

Free Features $66FREE

  • Most Qualified Writer $10FREE
  • Plagiarism Scan Report $10FREE
  • Unlimited Revisions $08FREE
  • Paper Formatting $05FREE
  • Cover Page $05FREE
  • Referencing & Bibliography $10FREE
  • Dedicated User Area $08FREE
  • 24/7 Order Tracking $05FREE
  • Periodic Email Alerts $05FREE
image

Services offered

Join us for the best experience while seeking writing assistance in your college life. A good grade is all you need to boost up your academic excellence and we are all about it.

  • On-time Delivery
  • 24/7 Order Tracking
  • Access to Authentic Sources
Academic Writing

We create perfect papers according to the guidelines.

Professional Editing

We seamlessly edit out errors from your papers.

Thorough Proofreading

We thoroughly read your final draft to identify errors.

image

Delegate Your Challenging Writing Tasks to Experienced Professionals

Work with ultimate peace of mind because we ensure that your academic work is our responsibility and your grades are a top concern for us!

Check Out Our Sample Work

Dedication. Quality. Commitment. Punctuality

Categories
All samples
Essay (any type)
Essay (any type)
The Value of a Nursing Degree
Undergrad. (yrs 3-4)
Nursing
2
View this sample

It May Not Be Much, but It’s Honest Work!

Here is what we have achieved so far. These numbers are evidence that we go the extra mile to make your college journey successful.

0+

Happy Clients

0+

Words Written This Week

0+

Ongoing Orders

0%

Customer Satisfaction Rate
image

Process as Fine as Brewed Coffee

We have the most intuitive and minimalistic process so that you can easily place an order. Just follow a few steps to unlock success.

See How We Helped 9000+ Students Achieve Success

image

We Analyze Your Problem and Offer Customized Writing

We understand your guidelines first before delivering any writing service. You can discuss your writing needs and we will have them evaluated by our dedicated team.

  • Clear elicitation of your requirements.
  • Customized writing as per your needs.

We Mirror Your Guidelines to Deliver Quality Services

We write your papers in a standardized way. We complete your work in such a way that it turns out to be a perfect description of your guidelines.

  • Proactive analysis of your writing.
  • Active communication to understand requirements.
image
image

We Handle Your Writing Tasks to Ensure Excellent Grades

We promise you excellent grades and academic excellence that you always longed for. Our writers stay in touch with you via email.

  • Thorough research and analysis for every order.
  • Deliverance of reliable writing service to improve your grades.
Place an Order Start Chat Now
image

Order your essay today and save 30% with the discount code ESSAYHELP