Comments on: I need help cleaning some dirty data

Question: I need help cleaning some dirty data

ashirys — Wed, 18 Mar 2009 11:34:54 -0800

Excel-filter: Mysterious single-quotes that precede the data in each cell. How do I get rid of them?

I'm working with a spreadsheet that's several years old. I suspect that the spreadsheet was created from a CSV file initially, but it was done before my time so I don't know for sure. Every entry in the first two columns is preceded by a single-quote. I think this was originally to force the text into..well, text, format that is. However, this character is causing these entries to not match other entries with the same text, sans single quote, which is a big problem for me. Things I've tried to get rid of these annoying characters:

=Clean()
Text->Columns
Changing the format (text, number, etc)
=Right(A1, Len(A1)-1) //this one chops off the first real character and leaves the single quote
Find & Replace using a copy/pasted single quote from an afflicted cell

Example of afflicted data, copy/pasted right from the spreadsheet:
'10807268

Nothing has worked except manually editing the cell and removing the character. Since I'm dealing with upwards of 10k cells, I really don't want to do this manually. Haven't managed to come up with anything on Google either. I'm using Excel 2007, though the file is .xls (rather than 2k7's .xlsx).

I'm not very good with macros, but willing to try them if they'll help.

By: mullacc

mullacc — Wed, 18 Mar 2009 11:39:18 -0800

What if you copy the afflicted cells and then paste special->values? Seems to work for me.

By: jeb

jeb — Wed, 18 Mar 2009 11:39:55 -0800

=Right(A1, Len(A1)-1) really doesn't work for you? Just to double check that, I copied/pasted your example into my Excel and then that formula right next to it and it works for me. Maybe there is something weird about this quote mark and its not roundtripping through mefi correctly?

By: Yorrick

Yorrick — Wed, 18 Mar 2009 11:41:04 -0800

Try selecting the column and changing the justification (like to centered), then changing it back to right justified.

By: carmicha

carmicha — Wed, 18 Mar 2009 11:41:21 -0800

The single apostrophe reflects a previous effort to show the numbers as text. To repair...

Highlight all of the affected cells.
Note little diamond with exclamation point that appears to the right.
Click downward arrow
Choose "Convert to Number."

By: ashirys

ashirys — Wed, 18 Mar 2009 11:58:41 -0800

Copy/Paste Special Values doesn't work. Changing justification doesn't do anything either. And I don't get the alert (diamond with !) when I select the cells.

I'm usually pretty good at figuring this sort of thing out, but I'm not having any luck except manual removal so far. Thanks for the suggestions - any other ideas I might try?

By: Doofus Magoo

Doofus Magoo — Wed, 18 Mar 2009 12:00:59 -0800

Have you tried =VALUE(A1) yet?

By: jackmcc

jackmcc — Wed, 18 Mar 2009 12:05:02 -0800

Maybe this is too simple, but it solved this problem for someone at my office recently.
-select all the cells with the quotes
-click Edit/Replace (or CTRL+f)
-click on the Replace tab
-enter a quote in Find What field
-in the Replace With field hit Delete
-click Replace All

That solved it for my colleague.

By: ashirys

ashirys — Wed, 18 Mar 2009 12:08:13 -0800

Progress, of sorts! Thanks, Doofus.

=Value(A1) works for the column of numbers. That's good. The other affected column has non-numeric data (I neglected to mention that initial question, sorry), and value doesn't work there. I may be able to get what I need by just fixing the numbers, but further suggestions for the text column are appreciated as well.

Find/Replace definitely does not work here.

By: Doofus Magoo

Doofus Magoo — Wed, 18 Mar 2009 12:09:31 -0800

Maybe =TRIM(A1) on the non-numeric column, and then a paste->special?

By: Doofus Magoo

Doofus Magoo — Wed, 18 Mar 2009 12:10:55 -0800

Sorry, that should be Paste Special->Values. And thinking about it now, the TRIM() is probably redundant -- maybe just =A1, and then a Paste Special->Values.

By: ashirys

ashirys — Wed, 18 Mar 2009 12:18:46 -0800

No dice with =Trim(), unfortunately. Or =A1.

It's a tenacious little bugger, it seems. Thanks again for the suggestions.

By: Doofus Magoo

Doofus Magoo — Wed, 18 Mar 2009 12:21:14 -0800

Is the single-quote visible in the cell for the non-numeric ones?

By: ashirys

ashirys — Wed, 18 Mar 2009 12:29:46 -0800

It's only visible in the editbox. Screenshot

By: marylynn

marylynn — Wed, 18 Mar 2009 12:33:59 -0800

Can you copy the column with the single quote into a new spreadsheet (which in my test got rid of the single quote) and then copy it back? Or copy it into Word, perhaps do a find/replace there, and then copy it back?

By: ROU_Xenophobe

ROU_Xenophobe — Wed, 18 Mar 2009 12:37:31 -0800

(1) Copy the first two columns to another spreadsheet
(2) Save it as a csv
(3) Open the csv in a text editor
(4) Search and replace ",`" with "," or just "`" with "".
(5) Save file in text editor
(6) Open resulting csv in excel, paste first two columns over original two columns

By: ashirys

ashirys — Wed, 18 Mar 2009 12:44:17 -0800

Marked all the answers that worked. You guys are life-savers, thanks!