M2.2 Importing large number of products The Next CEO of Stack Overflow413 - request entity too largeMagento 2 - Importing Configurable Products problem!Managing large number of customer groups and Productsimporting 12M products into magento2 instance?Importing products with custom optionsM1.9 - Handing a large amount of simple products?M2.2 Integrations issue with extensionsLarge import files under pub/media taking too much spaceImporting products.. please waitExporting / importing products
Is it reasonable to ask other researchers to send me their previous grant applications?
Is it OK to decorate a log book cover?
How can I prove that a state of equilibrium is unstable?
Another proof that dividing by 0 does not exist -- is it right?
How to find if SQL server backup is encrypted with TDE without restoring the backup
How to compactly explain secondary and tertiary characters without resorting to stereotypes?
How to unfasten electrical subpanel attached with ramset
Is it possible to create a QR code using text?
Car headlights in a world without electricity
How can I replace x-axis labels with pre-determined symbols?
Direct Implications Between USA and UK in Event of No-Deal Brexit
Incomplete cube
pgfplots: How to draw a tangent graph below two others?
How does a dynamic QR code work?
Are British MPs missing the point, with these 'Indicative Votes'?
Simplify trigonometric expression using trigonometric identities
Upgrading From a 9 Speed Sora Derailleur?
What difference does it make matching a word with/without a trailing whitespace?
What does this strange code stamp on my passport mean?
How can I separate the number from the unit in argument?
How seriously should I take size and weight limits of hand luggage?
"Eavesdropping" vs "Listen in on"
What did the word "leisure" mean in late 18th Century usage?
Arrows in tikz Markov chain diagram overlap
M2.2 Importing large number of products
The Next CEO of Stack Overflow413 - request entity too largeMagento 2 - Importing Configurable Products problem!Managing large number of customer groups and Productsimporting 12M products into magento2 instance?Importing products with custom optionsM1.9 - Handing a large amount of simple products?M2.2 Integrations issue with extensionsLarge import files under pub/media taking too much spaceImporting products.. please waitExporting / importing products
I'm importing a large number of products(15-20k) using a custom module importer that uses Magento's core API.
I would like to improve the speed of the Product Importer.
When I scaled up to 64 GB RAM in AWS, the server was using only 8-10 GB RAM on average. How do I configure PHP/MySQL/Opcache to utilise the memory and CPU available?
So far, I have tested to increase the PHP memory limit, MySql buffer size. Is there a way to analyse and test different configurations?
Note:
- Large imports are one time use.
magento2 server-setup aws
edited 2 days ago
Ronak Rathod
869112
asked 2 days ago
SivaSiva
61
New contributor
Siva is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
I'm importing a large number of products(15-20k) using a custom module importer that uses Magento's core API.
I would like to improve the speed of the Product Importer.
When I scaled up to 64 GB RAM in AWS, the server was using only 8-10 GB RAM on average. How do I configure PHP/MySQL/Opcache to utilise the memory and CPU available?
So far, I have tested to increase the PHP memory limit, MySql buffer size. Is there a way to analyse and test different configurations?
Note:
- Large imports are one time use.
magento2 server-setup aws
edited 2 days ago
Ronak Rathod
869112
asked 2 days ago
SivaSiva
61
New contributor
Siva is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
I'm importing a large number of products(15-20k) using a custom module importer that uses Magento's core API.
I would like to improve the speed of the Product Importer.
When I scaled up to 64 GB RAM in AWS, the server was using only 8-10 GB RAM on average. How do I configure PHP/MySQL/Opcache to utilise the memory and CPU available?
So far, I have tested to increase the PHP memory limit, MySql buffer size. Is there a way to analyse and test different configurations?
Note:
- Large imports are one time use.
magento2 server-setup aws
edited 2 days ago
Ronak Rathod
869112
asked 2 days ago
SivaSiva
61
New contributor
Siva is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
I'm importing a large number of products(15-20k) using a custom module importer that uses Magento's core API.
I would like to improve the speed of the Product Importer.
When I scaled up to 64 GB RAM in AWS, the server was using only 8-10 GB RAM on average. How do I configure PHP/MySQL/Opcache to utilise the memory and CPU available?
So far, I have tested to increase the PHP memory limit, MySql buffer size. Is there a way to analyse and test different configurations?
Note:
- Large imports are one time use.
magento2 server-setup aws
magento2 server-setup aws
edited 2 days ago
Ronak Rathod
869112
asked 2 days ago
SivaSiva
61
New contributor
Siva is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
edited 2 days ago
Ronak Rathod
869112
asked 2 days ago
SivaSiva
61
New contributor
Siva is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
edited 2 days ago
Ronak Rathod
869112
edited 2 days ago
Ronak Rathod
869112
edited 2 days ago
Ronak Rathod
869112
869112
asked 2 days ago
SivaSiva
61
New contributor
Siva is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked 2 days ago
SivaSiva
61
asked 2 days ago
SivaSiva
61
61
New contributor
Siva is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
Siva is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
Siva is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
add a comment |
0
active
oldest
votes
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "479"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Siva is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmagento.stackexchange.com%2fquestions%2f268041%2fm2-2-importing-large-number-of-products%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Siva is a new contributor. Be nice, and check out our Code of Conduct.
Siva is a new contributor. Be nice, and check out our Code of Conduct.
Siva is a new contributor. Be nice, and check out our Code of Conduct.
Siva is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Magento Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmagento.stackexchange.com%2fquestions%2f268041%2fm2-2-importing-large-number-of-products%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
