All add-ons currently require PHP 7.4 or greater.

On July 4th 2024 PHP 8.2 will be the new minimum requirement for all add-ons. Expect any add-on released after that date to require 8.2 or greater. Some releases may not immediately take advantage of 8.x specific features in PHP, which means you might, be able to continue using new releases in PHP 7.4, however, if you experience an error the first thing you should do is update to PHP 8.2 then create a support ticket if the error persists.

Publisher does not support the Fluid field type. Please do not contact asking when support will be available.

If you purchased an add-on from expressionengine.com, be sure to visit boldminded.com/claim to add the license to your account here on boldminded.com.

Ticket: Cron Jobs do not run but are queued

Status Resolved
Add-on / Version DataGrab 5.2.0
Severity
EE Version 6.4.15

Christian Rochford

Jan 24, 2024

Hi,
I have 2 imports configured and have created cron jobs on my server to run these every morning, however, the imports do not run but are queued and I still need to manually trigger them via the CP, do you know how I can avoid this so they’re run automatically
Thanks,
Christian

#1

BoldMinded (Brian)

I’m a little in the dark because I don’t know what exactly you have going on. Do you mind sharing what your cron looks like?

Did you create 2 cron’s, one for the producer and one for the consumer? https://docs.boldminded.com/datagrab/docs/automatic-imports/importing-with-cron#importing-large-data-sets

Is there anything in your log file that is suspicious? Can you share the log file?

#2

Christian Rochford

Comment has been marked private.

#3

BoldMinded (Brian)

Yeah, if you’re using the CLI, then you’ll need to use the commands instead of the action url.

#4

Christian Rochford

Comment has been marked private.

#5

BoldMinded (Brian)

The action URL no longer imports everything… if you’re trying to import 5000 entries, then doing that in a single request is not viable. It requires some human intervention or whatever is making the http can also refresh the same page. This is a new UI I’m working on for the action request… but it’s always tried to auto refresh the page or require a human to click the continue button. If Plesk can do that, then great, if not, then you’ll need to change Plesk to run the CLI command.

#6

BoldMinded (Brian)

“The action URL no longer imports everything” - I sort of take that back. I you’re importing 100 entries, then you can change the batch size in the configuration to 100, but if the feed changes and there are 110 entries one day, then it won’t import the last 10 (so set the batch size to 200 or something). If it doesn’t import then b/c it’s timing out, then that isn’t something I can help with. That’s why I made the CLI commands… because they work better with larger imports.

#7

BoldMinded (Brian)

To summarize, it sounds like you need to increase your batch size, or switch to the CLI command. The next comment will include a new build that improves the action url operations though… someone else was having some weird issues.

#8

BoldMinded (Brian)

Comment has been marked private.

#9

Christian Rochford

Comment has been marked private.

#10

BoldMinded (Brian)

Sounds good. I’ll close this out for now then, feel free to re-open it if you need to.

Login to reply