Data capture from one of the private Big Commerce URL(https) to export it into excel

[SantoshTV]

Hi,

I’m very new to use Knime Analytics Platform. Require anyone’s help to share me the workflow pipeline in Knime that captures data dynamically (date range changes as per demand) from one of the private and secure Big Commerce URL and allows it to export to .XLS/.CSV file.

Thank you

[knimediger]

@SantoshTV

First of all: Welcome to the world of KNIME.

There is a multitude of examples available demonstratating how read webpages and extract data from them.
Maybe you have a look at

Parsing a website

Hey there, I want to parse a job board (https://www.accenture.com/de-de/careers/jobsearch) on a website and extract all the titles in the ads together with the links. I tried to follow through based on the parsing the KNIME forum workflow from the example server but this returns only missing values. I assume that this is due to the fact that the forum structure may have changed in the meantime. The main problem I have that in the results I get from the HTML parser node I cannot find any of th…

Webpage Retriever

Webpage Retriever — NodePit

Get the content of a web page in KNIME

If you share some more details (e.g. the webpage and what data you would like to read) the community might give you some more specific hints.

What’s the reason to put the data into xls files?
For purposes like data storage or visualisation you could also make use of KNIME and it’s power tool landscape.

[SantoshTV]

Thank you for your inputs. There is a BigCommerce (https URL) and it contains specific dimensions categorised as Orders, Customers, Stores, etc . By manual process , we go to Orders section and from there we try to export CSV data after applying custom date range filter as per business needs . This data is intended to be sent to PowerBI for further visualization.

Finally , I require this process to be developed as a workflow in Knime which will avoid manual process right from going to URL------>Selecting Orders-----> Custom Data Range Filter Application . Thus by running this Knime workflow, we should have .XLS file generated and that will be used for PowerBI visualization. Anyone please share me this workflow.

Thanks.

[ipazin]

Hello @SantoshTV

@SantoshTV

Anyone please share me this workflow.

Don’t think someone can and will share a workflow you can just take and use in this case. However you can search KNIME Hub for similar examples and start building your pipeline like that. Also you might be able to use GET Request node to fetch data if REST API is available on your source.

@SantoshTV

This data is intended to be sent to PowerBI for further visualization.

You can also use KNIME Power BI Integration extension to send data into Power BI.

Welcome to KNIME Community!

Br,
Ivan

[bruno29a]

Hi @SantoshTV , and welcome to the Knime Community. Can you show us what you have attempted so far, that can help us point you to the right direction?