Publisher does not support the Fluid field type. Please do not contact asking when support will be available.

If you purchased an add-on from expressionengine.com, be sure to visit boldminded.com/claim to add the license to your account here on boldminded.com.

Ticket: Error: No such property: ‘dbforge’ on ExpressionEngine\Legacy\Facade

Status	Resolved
Add-on / Version	DataGrab 5
Severity
EE Version	7.2.7

Jelle / Karres en Brands

Feb 27, 2023

Good morning!
I just hit update (coming from DG 4.1.0 to the v5 beta and got: Error: No such property: ‘dbforge’ on ExpressionEngine\Legacy\Facade

BoldMinded (Brian)

Feb 28, 2023

Well that’s not a good start. Does it include the file name and line number the error is from?

Jelle / Karres en Brands

Feb 28, 2023

Nope, nothing at all

BoldMinded (Brian)

Feb 28, 2023

Comment has been marked private.

Jelle / Karres en Brands

Feb 28, 2023

Hi Brian!
The new build did install properly. However, when starting/restarting an import, even with the batches set to 20 i keep getting 503’s

BoldMinded (Brian)

Feb 28, 2023

Have you checked your php error log files?

BoldMinded (Brian)

Feb 28, 2023

What about inspecting the network tab to see what the response is? A 503 is pretty vague and doesn’t point me in a direction to debug… kind of need some error message or more context. Did it properly add the exp_datagrab_jobs table?

Jelle / Karres en Brands

Feb 28, 2023

Comment has been marked private.

BoldMinded (Brian)

Feb 28, 2023

Thanks for that. I’m more looking for the actual Ajax http response though.

Are you able to share a CP login and I can take a look? If so edit the ticket and use the provided fields for the login info.

Jelle / Karres en Brands

Feb 28, 2023

Something is working now. Not sure if everything does, will let you know in a bit. turns out setting the php max memory to 512mb in cpanel did not have effect and was set to 64MB although i couldn’t see that

#10

Jelle / Karres en Brands

Feb 28, 2023

ok. just thought i’d try again with a brandnew import
this file: https://pf.tradetracker.net/?aid=184973&encoding=utf-8&type=xml-v2-simple&fid=254528&categoryType=2&additionalType=2
setting this as an XML import
Getting this error:
Configuration Error
Cannot parse the XML from file/url: https://pf.tradetracker.net/?aid=184973&encoding=utf-8&type=xml-v2-simple&fid=254528&categoryType=2&additionalType=2

#11

Jelle / Karres en Brands

Feb 28, 2023

edited the ticket, you should be able to login now

#12

BoldMinded (Brian)

Feb 28, 2023

When I try to view that XML file my browser is prompting me to download it instead of viewing it in the browser… that could be tripping up DG.

#13

Jelle / Karres en Brands

Feb 28, 2023

that’s kind of weird since i’ve been using these feeds for a long time with old DG and Smart import/export. But yes when i put the url in the adress bar it downloads it too. Which it did for as long as i an remember.

#14

BoldMinded (Brian)

Feb 28, 2023

You don’t currently have any imports configured.

#15

BoldMinded (Brian)

Feb 28, 2023

FWIW nothing was changed with how DG reads files in version 5, so if it worked in a previous version it should still work the same in this version. Try to save a version of the XML file locally and configure your import using a local file and see if it works that way.

#16

Jelle / Karres en Brands

Mar 01, 2023

Hi Brian,
I did have some imports defined. However, this morning i just decided to uninstall DG and reinstall it. Start with a blank slate. However, after installing DG and clicking on the settingsi get this error:
Exception Caught
SQLSTATE[42S22]: Column not found: 1054 Unknown column ‘import_deleterecords’ in ‘field list’:
SELECT `id`, `name`, `description`, `passkey`, `import_status`, `import_lastrecord`, `import_totalrecords`, `import_deleterecords`, `last_run`, `settings` FROM (`exp_datagrab`) WHERE `site_id` = ‘1’ ORDER BY `name` ASC

#17

Jelle / Karres en Brands

Mar 01, 2023

so. uninstalled again, deleted the tables manually from the DB, and reinstalled. There are now 4 tables (previously 3)
I downloaded a product feed and put it on the server. Getting:
Configuration Error
Cannot parse the XML from file/url: https://www.vakantiehuis-in-italie.nl/assets/xml/productfeed.xml)
So i generated a different xml feed: https://pf.tradetracker.net/?aid=184973&encoding=utf-8&type=xml-v2-simple&fid=254528&categoryType=2&additionalType=2
same result.
So XML didn’t work, tried a JSON feed. Got that configured, but it isn’t actually importing anything. Even though it’s trying.
Next up a CSV file. But either remote or locally the configuration page is empty - no fields found

#18

BoldMinded (Brian)

Mar 01, 2023

Did you check the DataGrab-import.log file? Please copy/paste the output in that file so I can see what is going on.

#19

BoldMinded (Brian)

Mar 01, 2023

According to https://codebeautify.org/xmlvalidator it’s invalid XML. First step is to make sure it passes xml validation. Next step, since it’s a 14mb file is to make it a smaller file to see if it can read and configure the import correctly. If so, then try the 14mb file.

#20

BoldMinded (Brian)

Mar 01, 2023

https://docs.boldminded.com/datagrab/docs/troubleshooting

#21

Jelle / Karres en Brands

Mar 01, 2023

Comment has been marked private.

#22

BoldMinded (Brian)

Mar 01, 2023

Please share the DataGrab-import.log file.

#23

Jelle / Karres en Brands

Mar 01, 2023

Comment has been marked private.

#24

BoldMinded (Brian)

Mar 01, 2023

Comment has been marked private.

#25

Jelle / Karres en Brands

Mar 02, 2023

Comment has been marked private.

#26

BoldMinded (Brian)

Mar 02, 2023

Comment has been marked private.

#27

Jelle / Karres en Brands

Mar 06, 2023

Hi Brian,
I’ve set up a new import (json) which works fine for as far as i can see now. However, it does seem very slow. I’ve set the batch size to 20, but it looks like this is ignored. I’m importing only 2 entries per minute. And with 7749 records in the feed this takes a long time

#28

BoldMinded (Brian)

Mar 06, 2023

According to your datagrab_jobs table you have 646,730 items waiting to be imported… does this sound correct? If not then you may need to truncate that table to remove all the jobs and then re-start the import. There is a new trash can icon in the actions group to purge the jobs queue.

#29

BoldMinded (Brian)

Mar 06, 2023

And it’s queued up 9,708 entries for deletion… does that sound right?

#30

Jelle / Karres en Brands

Mar 06, 2023

Hi Brian,
The 646K items is way too much. there should be 7749 items in the #2 import. I just deleted the #1 import anyway
The deletion of 9708 items might well be correct.

I purged the qeue and continued the import. However, when importing from the CP i’m seeing a lot of ajax requests are rapidly being fired, which leads to err_insufficient_resources and some erratic behaviour in the status bar gif / waiting text.

I can’t see how to stop the current import. It’s starting / running wether of not i’m on the DG page

#31

BoldMinded (Brian)

Mar 06, 2023

I’ve been meaning to add a “restart” option to reset everything. For now the best way to stop it is to purge the queue (or manually delete everything form the exp_datagrab_jobs table)

#32

Jelle / Karres en Brands

Mar 06, 2023

The purge button isn’t there when an import is running, so there’s no way to purge/pause/stop an import from the CP

#33

BoldMinded (Brian)

Mar 07, 2023

Comment has been marked private.

#34

Jelle / Karres en Brands

Mar 08, 2023

Comment has been marked private.

#35

BoldMinded (Brian)

Mar 08, 2023

Did you test that FTP login? Doesn’t seem to be working for me. Tried SFTP and passive FTP.

#36

BoldMinded (Brian)

Mar 11, 2023

I was able to get in with Cyberduck… Transmit didn’t want to connect :/

#37

BoldMinded (Brian)

Mar 18, 2023

Closing this out bc as mentioned in Slack I think I have the speed issue sorted out and I’ll share a new build in a few days.