Publisher does not support the Fluid field type. Please do not contact asking when support will be available.

If you purchased an add-on from expressionengine.com, be sure to visit boldminded.com/claim to add the license to your account here on boldminded.com.

Ticket: Error: No such property: ‘dbforge’ on ExpressionEngine\Legacy\Facade

Status Resolved
Add-on / Version DataGrab 5
Severity
EE Version 7.2.7

Jelle / Karres en Brands

Feb 27, 2023

Good morning!
I just hit update (coming from DG 4.1.0 to the v5 beta and got: Error: No such property: ‘dbforge’ on ExpressionEngine\Legacy\Facade

#1

BoldMinded (Brian)

Well that’s not a good start. Does it include the file name and line number the error is from?

#2

Jelle / Karres en Brands

Nope, nothing at all

#3

BoldMinded (Brian)

Comment has been marked private.

#4

Jelle / Karres en Brands

Hi Brian! The new build did install properly. However, when starting/restarting an import, even with the batches set to 20 i keep getting 503’s

#5

BoldMinded (Brian)

Have you checked your php error log files?

#6

BoldMinded (Brian)

What about inspecting the network tab to see what the response is? A 503 is pretty vague and doesn’t point me in a direction to debug… kind of need some error message or more context. Did it properly add the exp_datagrab_jobs table?

#7

Jelle / Karres en Brands

Comment has been marked private.

#8

BoldMinded (Brian)

Thanks for that. I’m more looking for the actual Ajax http response though.

Are you able to share a CP login and I can take a look? If so edit the ticket and use the provided fields for the login info.

#9

Jelle / Karres en Brands

Something is working now. Not sure if everything does, will let you know in a bit. turns out setting the php max memory to 512mb in cpanel did not have effect and was set to 64MB although i couldn’t see that

#10

Jelle / Karres en Brands

ok. just thought i’d try again with a brandnew import this file: https://pf.tradetracker.net/?aid=184973&encoding=utf-8&type=xml-v2-simple&fid=254528&categoryType=2&additionalType=2 setting this as an XML import Getting this error: Configuration Error Cannot parse the XML from file/url: https://pf.tradetracker.net/?aid=184973&encoding=utf-8&type=xml-v2-simple&fid=254528&categoryType=2&additionalType=2

#11

Jelle / Karres en Brands

edited the ticket, you should be able to login now

#12

BoldMinded (Brian)

When I try to view that XML file my browser is prompting me to download it instead of viewing it in the browser… that could be tripping up DG.

#13

Jelle / Karres en Brands

that’s kind of weird since i’ve been using these feeds for a long time with old DG and Smart import/export. But yes when i put the url in the adress bar it downloads it too. Which it did for as long as i an remember.

#14

BoldMinded (Brian)

You don’t currently have any imports configured.

#15

BoldMinded (Brian)

FWIW nothing was changed with how DG reads files in version 5, so if it worked in a previous version it should still work the same in this version. Try to save a version of the XML file locally and configure your import using a local file and see if it works that way.

#16

Jelle / Karres en Brands

Hi Brian, I did have some imports defined. However, this morning i just decided to uninstall DG and reinstall it. Start with a blank slate. However, after installing DG and clicking on the settingsi get this error: Exception Caught SQLSTATE[42S22]: Column not found: 1054 Unknown column ‘import_deleterecords’ in ‘field list’: SELECT id, name, description, passkey, import_status, import_lastrecord, import_totalrecords, import_deleterecords, last_run, settings FROM (exp_datagrab) WHERE site_id = ‘1’ ORDER BY name ASC

#17

Jelle / Karres en Brands

so. uninstalled again, deleted the tables manually from the DB, and reinstalled. There are now 4 tables (previously 3) I downloaded a product feed and put it on the server. Getting: Configuration Error Cannot parse the XML from file/url: https://www.vakantiehuis-in-italie.nl/assets/xml/productfeed.xml) So i generated a different xml feed: https://pf.tradetracker.net/?aid=184973&encoding=utf-8&type=xml-v2-simple&fid=254528&categoryType=2&additionalType=2 same result. So XML didn’t work, tried a JSON feed. Got that configured, but it isn’t actually importing anything. Even though it’s trying. Next up a CSV file. But either remote or locally the configuration page is empty - no fields found

#18

BoldMinded (Brian)

Did you check the DataGrab-import.log file? Please copy/paste the output in that file so I can see what is going on.

#19

BoldMinded (Brian)

According to https://codebeautify.org/xmlvalidator it’s invalid XML. First step is to make sure it passes xml validation. Next step, since it’s a 14mb file is to make it a smaller file to see if it can read and configure the import correctly. If so, then try the 14mb file.

#20

BoldMinded (Brian)

https://docs.boldminded.com/datagrab/docs/troubleshooting

#21

Jelle / Karres en Brands

Comment has been marked private.

#22

BoldMinded (Brian)

Please share the DataGrab-import.log file.

#23

Jelle / Karres en Brands

Comment has been marked private.

#24

BoldMinded (Brian)

Comment has been marked private.

#25

Jelle / Karres en Brands

Comment has been marked private.

#26

BoldMinded (Brian)

Comment has been marked private.

#27

Jelle / Karres en Brands

Hi Brian, I’ve set up a new import (json) which works fine for as far as i can see now. However, it does seem very slow. I’ve set the batch size to 20, but it looks like this is ignored. I’m importing only 2 entries per minute. And with 7749 records in the feed this takes a long time

#28

BoldMinded (Brian)

According to your datagrab_jobs table you have 646,730 items waiting to be imported… does this sound correct? If not then you may need to truncate that table to remove all the jobs and then re-start the import. There is a new trash can icon in the actions group to purge the jobs queue.

#29

BoldMinded (Brian)

And it’s queued up 9,708 entries for deletion… does that sound right?

#30

Jelle / Karres en Brands

Hi Brian, The 646K items is way too much. there should be 7749 items in the #2 import. I just deleted the #1 import anyway The deletion of 9708 items might well be correct.

I purged the qeue and continued the import. However, when importing from the CP i’m seeing a lot of ajax requests are rapidly being fired, which leads to err_insufficient_resources and some erratic behaviour in the status bar gif / waiting text.

I can’t see how to stop the current import. It’s starting / running wether of not i’m on the DG page

#31

BoldMinded (Brian)

I’ve been meaning to add a “restart” option to reset everything. For now the best way to stop it is to purge the queue (or manually delete everything form the exp_datagrab_jobs table)

#32

Jelle / Karres en Brands

The purge button isn’t there when an import is running, so there’s no way to purge/pause/stop an import from the CP

#33

BoldMinded (Brian)

Comment has been marked private.

#34

Jelle / Karres en Brands

Comment has been marked private.

#35

BoldMinded (Brian)

Did you test that FTP login? Doesn’t seem to be working for me. Tried SFTP and passive FTP.

#36

BoldMinded (Brian)

I was able to get in with Cyberduck… Transmit didn’t want to connect :/

#37

BoldMinded (Brian)

Closing this out bc as mentioned in Slack I think I have the speed issue sorted out and I’ll share a new build in a few days.

Login to reply