How to read multiple lines from PDF File

[Subramanyam]

Hi Team,

I want to read multiple lines from the PDF File. I have used the PDF Parser as well as the Tika Parser node but unable to fetch the details. Please help me in resolving the issue.
We have already workflow which will extract the PDF details if it is having one line details.
I am uploading the PDF File in doc format as I am unable to upload in PDF format as well as the workflow too.
SG 4503089325.pdf.docx (63.2 KB)
Automation-IDOC–Singapore.knwf (126.9 KB)

Please lemme know for further details.

Thanks,
Subramanyam Kinthada

[ScottF]

Hi @Subramanyam -

Please don’t post new topics in the KNIME Development forum unless they are specifically related to node development, the KNIME SDK, or similar. I have moved your topic to the main Analytics Platform forum.

Is this question related to your already existing topic posted here, or is this new? unable to read all the details from PDF file using PDF parser node

[Subramanyam]

Hi @ScottF,

Yes it is related to the same topic but here the input file consists of multiple lines and hence we are unable to fetch the details using PDF Parser or Tika Parser.

From the The input PDF file we need to generate Two Text files Header file and Detailed File.

Header File consists of the below details from PDF. As we have multiple lines we need to generate those many number of header lines.
PO Number–4503089325
shipment code—2003085667
PO Date–09.05.2022
Deliverydate–11.05.2022
Quantity
Amount

The output of the files has to be in the below format
edrpod_2000894913_20220617_1.txt (20.0 KB)
edrpoh_2000894913_20220617_1.txt (299 Bytes)

Please let me know if any details required.

Thanks,
Subramanyam Kinthada.

[Subramanyam]

Hi Team,

I have attached all the required files and please help me in resolving the issue.
Lemme know for further details.

Thanks,
Subramanyam Kinthada.

[ScottF]

I took a look at what you posted. As you know, parsing text from PDFs in a non-trivial and oftentimes very frustrating problem - so I sympathize. But you should realize that without focused details it is unlikely that anyone is going to be able to help you. I say this because:

• You have posted a large workflow without context on specifically where you are having a problem. Your workflow is largely unannotated and without any descriptive text. Basically, no one can understand what you’ve already tried.
• It is is difficult to understand at a glance what your output represents, as there are no headers in the output datasets.
• Parts of your workflow just don’t execute (e.g. Cross Joiner, String Manipulation)

I would suggest breaking your workflow into smaller chunks, and focusing on one problem at a time. Remember that people here in the forum are volunteering their time to help you, this isn’t a consulting firm. So give them as many details as possible in a concise way, to help them help you.

[mlauber71]

@Subramanyam you could try and use the R package pdftools to extract the text. It will also extract the content of the table but there might be better ways to deal with them as we already have discussed - Solutions to "Just KNIME It!" Challenge 15, Extract Table from PDF with the help of R "tabulizer" and KNIME – KNIME Hub).

Every page will be in a table row so you might take it from there and start splitting and manipulating the header in order to get your information.

use R and KNIME to extract text from PDF file – mlauber71

kn_example_r_pdf_read_text.knwf (95.6 KB)

Then I would agree with what @ScottF says. It is difficult to follow what you want to do and at which point the community might be able to help. BTW you can enclose data within the node (preferably in the subfolder /data/) so you can have a complete example that other people might be able to run.

[Subramanyam]

Hi @mlauber71,

I have tried the R source table extract node but I am facing the below issue.

do we have any other node which will extract the PDF details into table format so that I can proceed with next formatting.

Thanks in advance.
Subramanyam Kinthada.

[mlauber71]

@Subramanyam you will have to install R and the package mentioned. Best to start with the official guide:

https://docs.knime.com/latest/r_installation_guide/index.html

Or you can use conda environment propagation and python to also install R.

Data separate and melting

@cuongnguyen maybe you try again with some more basic settings and a newer R version (4.1.3) which is available via conda(-forge). Your environment propagation has a lot of special linux packages that I cannot install on Windows/MacOS - so I set up a more generic YAML file - you could add other packages and update the environment later. [image] The YML/YAML file would look like this # conda env create -f py39_knime_r.yml # conda env update -f py39_knime_r.yml --prune # https://forum.knime.…

[badger101]

I notice this isn’t the first time this happens, @ScottF since you’ve also mentioned this a while ago to them:

replace the delimiters

Hi @Subramanyam - In addition to what @bruno29a suggested, I would point out a couple of other things in the spirit of maintaining a helpful, healthy forum community. The KNIME Development forum is for questions about node development, the KNIME SDK, and so forth. It’s not for questions about which nodes to use, or how to build workflows for particular use cases. Those go in the main Analytics Platform forum, which gets lots more traffic anyway. (I have moved this and one of your other topic…

In that thread, your comment (and @Daniel_Weikert 's comment too) wasn’t acknowledged at all, as in the case on this one. I’m curious to see what happens in the future.

[Subramanyam]

Hi @mlauber71,

Thanks for your suggestion,

As the above recommended process not accepting in servers do we have any other possible way to extract the details from the table in the attached PDF File.

If its possible, please kindly help me in resolving the issue.

Attaching the PDF file with .docx extension. This is a dummy data.
SG 4503089325.pdf.docx (63.2 KB)

Thanks in advance,
Subramanyam Kinthada.

[Subramanyam]

Hi Team,

while installing rserve using the below commands using Rtools42 I am facing the below error. Please help me in resolving the issue. Please refer to the below screen shot

Thanks,
Subramanyam Kinthada.

[mlauber71]

@Subramanyam installing R and make it work with knime still might face some challenges. You might want to start by reading the official guide

https://docs.knime.com/latest/r_installation_guide/index.html#_introduction

For the installation of Rserve (which you will need) these entry might help:

R integration: Cannot install Rserve

@ehsanT what you should do is make sure RServe does run under R / Studio alone and will be started when library(“Rserve”) is called. Then you could tray the integration into KNIME. In order to do a fresh installation you might try these steps if the ones from the R integration guide would not work. The latest Version 1.8-10 should be available as a Windows binary so there would be no need to compile: https://CRAN.R-project.org/package=Rserve For Windows: install.packages("Rserve", repos = "h…

Then there is the collection sich also describes the option to use Conda Environment Propagation to install R and necessary dependencies with the help of conda.

A meta collection and article about R and KNIME – mlauber71

Here is the conda and R installation with an example (maybe use Miniforge as your conda environment installer https://github.com/conda-forge/miniforg)

Data separate and melting

@cuongnguyen maybe you try again with some more basic settings and a newer R version (4.1.3) which is available via conda(-forge). Your environment propagation has a lot of special linux packages that I cannot install on Windows/MacOS - so I set up a more generic YAML file - you could add other packages and update the environment later. [image] The YML/YAML file would look like this # conda env create -f py39_knime_r.yml # conda env update -f py39_knime_r.yml --prune # https://forum.knime.…