Voters 4
-
-
J
-
M
-
N
4
Support data with comma's in CSV
- Live
 |
Kyle |
I did a CSV export of data that had monetary amounts such as $2,321.00. The export did not put the dollar amount in quotes, so importing caused it to appear as two columns, "$2" and "321.00".
Activity Newest / Oldest
Kyle
Status changed to: Live
Nigel
A CSV file is useful only if it has proper delimiters and quotes for the string data.
For my use case, I am trying to use Task Magic to type text on a website and scrape the output text from the website.
Because of other bugs ( listed at the end ) in Task Magic, the only reliable way I found to save the scrapped text is to use CSV download option from Traffic Control out.
Unfortunately, in the downloaded CSV file, the scrapped text is not enclosed in quotes. Because of this, if the scrapped text contains comma, which is the commonly used delimiter in tools like Google Sheet and Excel, when I import the downloaded CSV file, the text gets split into multiple columns, hence corrupting the data.
Here's the loom recording of the CSV file when imported to Google Sheets: www.loom.com/share/665d91deb35f41aba0d001bb2f7062d5
As you can see, instead of two columns as seen in the CSV preview of Traffic Control, it ends up with multiple columns because of "," from the scrapped text.
The other bugs which forces me to rely on manually downloaded CSV file from Traffic control:
1. If I add a Google Sheet app action to save scrapped text, it just hangs there with no progress and doesn't write the scrapped text to Google Sheets during actual run ( even though it works when you are setting up the automation workflow )
2. The Send to Google Sheets settings of the automation is another way to export scrapped text. However, it doesn't work either, especially if the automation suddenly stopped due to some error.
Could you please check it this? I have also added relevant screenshots.
You can also see a screenshot of proper CSV file downloaded from Google Sheets where the column text is wrapped in quotes if the text contains comma.
I have also shared screenshot of an example improper CSV file that would be generated by Task Magic, which would turn in to 4 columns instead of 2 columns when imported to Google Sheet.
Kyle
Merged with: CSV downloaded from Traffic Control Data Out is not proper if scrapped data has comma
Kyle
Post moved to this board
Web
Instead of using the "Send to Google Sheets" option, have you tried using the App-Builder? Scrape your text in step 6 and step 12, but then webhook it over to the app-builder?
I don't know about you, but I don't notifications when responses hit these bug requests. If you see this, hit me up on the task magic FB page under "Alex Smith":
www.facebook.com/groups/taskmagic
I don't disagree that the CSV stuff should work, but maybe there's a work around so as not to be stuck waiting?
Nigel
> Scrape your text in step 6 and step 12, but then webhook it over to the app-builder?
I will try that. Meanwhile, I am using two separate automation for eacb scraping step. I use VS Code to add quotes to each line and then import to Google Sheet.
Google Sheet is helpful for me to do check the scraped data and make any adjustments if necessary.
I will join the FB page.
Matt
I was following your YouTube tutorial to scrape businesses from Yellow Pages results and upload the results to Google Sheets.
I searched for CPAs in Colorado Springs, CO. Because they're CPAs, there are a lot of results with commas in the business name. It seems all of these extra commas are throwing off the "Send to Google Sheets" feature and CSV exports.
I have 300 rows of results (30 results per page, loop 10 times), but a lot of the scrapping data is mismatched. It's a jumbled mess by the bottom rows. I have incorrect addresses for businesses and wrong phone numbers in the scrapped data.
CSVs are great for data, but not when you're data contains a lot of commas. It'd be great to use a different, less common delimiter or provide an option to change the delimiter from commas to something else.
Kyle
Merged with: Comma Separated Values