Publisher does not support the Fluid field type. Please do not contact asking when support will be available.

If you purchased an add-on from expressionengine.com, be sure to visit boldminded.com/claim to add the license to your account here on boldminded.com.

Ticket: Datagrab: web/ACT running of an import seems to honor more settings than does the the CLI version

Status Resolved
Add-on / Version Bloqs 421
Severity
EE Version 643

Paul Larson

Jan 05, 2023

Testing side-by-side, I’ve noticed:

Clicking ‘Run Import’ in the DataGrab web interface properly honors the imports ‘status’ settings. And the ‘skip first row’ setting.

The same import, in my case, ID 59, run from CLI does not honor these.

 

#1

Paul Larson

Jan 05, 2023

Also noticing (can’t recall if it’s CLI or web/ACT), DG adds _1 to a url_title, e.g. my_url_title_1. It might be intentional, but it’s troublesome for my use case.

#2

Paul Larson

Jan 05, 2023

Comment has been marked private.

#3

Paul Larson

Jan 05, 2023

Comment has been marked private.

#4

Paul Larson

Jan 05, 2023

Despite my chart - I see some variation. I think it’s worth clarifying:

* What situation causes DG to append _1 to a url_title, when the entry is an update, not a create?
* I’m finding ‘Status’ to be much less consistent than I thought. For this site, the status should never change on import. Sometimes it works, sometimes it doesn’t

 

#5

BoldMinded (Brian)

Jan 05, 2023

First it shouldn’t be adding _1, if anything it add’s just a “1” to the end. It does this to ensure the url_title is unique. This makes it sound like there are duplicate url_titles on your site, so it’s trying to make them unique. I saw your thread https://eecms.slack.com/archives/C04CUNNR9/p1672944408706309 Are those entries in the same channel? If so then adding “1” or “_1” would be appropriate.

#6

BoldMinded (Brian)

Jan 05, 2023

It’s going to be a couple days until I can look into these, sorry. Pretty busy right now.

#7

BoldMinded (Brian)

Jan 06, 2023

Comment has been marked private.

#8

Paul Larson

Jan 06, 2023

Comment has been marked private.

#9

Paul Larson

Jan 06, 2023

Dang it - hold a bit.

PHPStorm didn’t refresh/know about the latest updates from the add-on file.

Stay tuned.

#10

Paul Larson

Jan 06, 2023

Ok, made sure to upload the entirety of new build.

CLI still changes status from Open to Draft.

When I turn ON setting to skip header row, the logging is confusing.
~
~
~
16:03:58 01/06/2023 Import #59 Started
16:03:58 01/06/2023 Import #59 Initialized
16:03:58 01/06/2023 Begin Importing [1080BIRMINGHAM]
16:03:58 01/06/2023 [1080BIRMINGHAM] already exists. Updating.
16:04:00 01/06/2023 Calling after_channel_entry_save() hook.
16:04:00 01/06/2023 Updated 1 entries
16:04:00 01/06/2023 Begin Importing [ITEM_NO]
16:04:00 01/06/2023 [ITEM_NO] already exists. Updating.
16:04:01 01/06/2023 Import error with entry ITEM_NO with the field_id_90 field: Numeric
16:04:01 01/06/2023 Updated 1 entries
16:04:01 01/06/2023 Begin Importing [ITEM_NO]
16:04:01 01/06/2023 [ITEM_NO] already exists. Updating.
16:04:03 01/06/2023 Import error with entry ITEM_NO with the field_id_90 field: This field must contain only numbers.
16:04:03 01/06/2023 Updated 1 entries
~
~
~
Good that it seems 1080BIRMINGHAM, but odd that it repeats ITEM_NO, which should be the (skipped) header row.


When I manually remove the header row (and turn off ‘SKIP’ setting), the log is different but still confusing (repeats of BIRMINGHMAM, whole there are 3 SKUs in the file)

16:10:23 01/06/2023 Import #59 Started
16:10:23 01/06/2023 Import #59 Initialized
16:10:23 01/06/2023 Begin Importing [1080BIRMINGHAM]
16:10:23 01/06/2023 [1080BIRMINGHAM] already exists. Updating.
16:10:25 01/06/2023 Calling after_channel_entry_save() hook.
16:10:25 01/06/2023 Updated 1 entries
16:10:25 01/06/2023 Begin Importing [1080BIRMINGHAM]
16:10:25 01/06/2023 [1080BIRMINGHAM] already exists. Updating.
16:10:27 01/06/2023 Calling after_channel_entry_save() hook.
16:10:27 01/06/2023 Updated 2 entries
16:10:27 01/06/2023 Begin Importing [1080BIRMINGHAM]
16:10:27 01/06/2023 [1080BIRMINGHAM] already exists. Updating.
16:10:29 01/06/2023 Calling after_channel_entry_save() hook.
16:10:29 01/06/2023 Updated 3 entries

#11

BoldMinded (Brian)

Jan 07, 2023

New build provided in the other ticket, hopefully it resolves most/all of these issues.

#12

BoldMinded (Brian)

Jan 10, 2023

I think the new build fixes the issue, except for 1 or 0 row CSV files https://boldminded.com/support/ticket/2563

Closing this ticket.

Login to reply