Are there any good examples of using KNIME with ChatGPT (or some other NLP model) for Text Similarity & Matching to compare key sections of a text document (e.g, job description) to determine if it is a close match to the source list of descriptions? For example, if I am comparing job descriptions with benchmarks from industry surveys? I would have have Excel files with discreet lines of data from parsed job descriptions.
Could you provide some sample data? Without knowing the exact structure of your data its difficult to help.
You didn’t reply to my last post so I proceeded to develop a similarity workflow. Its very simplistic, but it might get you started.
2 Likes
Thank you for putting this together and I am sorry for my slow response.
Below is a brief example of what I am working with. Survey descriptions could total 1000+ and internal descriptions would be fewer in volume. I will try to test what you have put together here. Again, I appreciate the assistance.
Survey Description:
Procurement Analyst, Senior
Second of two levels of professional roles supporting the organization’s procurement function. The job typically requires a bachelor’s degree and 5+ years of experience. Analyzes and optimizes purchasing processes to achieve cost-effective sourcing and efficient supply chain management. Develops and implements advanced competitive analysis to support strategic sourcing decisions. Leads procurement reporting requirements ensuring access to critical market and supplier performance data. Manages supplier rating systems and takes a lead role in contract negotiations for high-value purchases and recommends sourcing strategies for critical purchasing areas. Enforces purchasing policies to maintain compliance with inventory standards and identifies opportunities for improvement in order to optimize inventory levels and reduce costs. Works with limited supervision, often providing guidance to less experienced analysts.
Procurement Analyst
First of two levels of professional roles supporting the organization’s procurement function. The job typically requires a bachelor’s degree and 2+ years of experience. Analyzes and optimizes purchasing processes to achieve cost-effective sourcing and efficient supply chain management. Conducts market research and competitive analysis using supply chain intelligence platforms to enhance procurement strategies and reporting. Designs and maintains procurement dashboards and reports, ensuring uniform access to critical data. Evaluates suppliers, gathers and analyzes RFP/RFQ responses, and assists in negotiating contracts that meet the organization’s cost, quality, and compliance standards. Collaborates on inventory and cost forecasting, supporting the organization with budget management and adherence to corporate purchasing policies. Works under general supervision within established guidelines.
Internal Description
A Procurement Analyst is responsible for analyzing purchasing data, supplier performance, and market trends to optimize procurement strategies and cost efficiency. This role involves evaluating contracts, negotiating terms, and ensuring compliance with company policies and industry regulations. The analyst collaborates with internal teams to identify sourcing opportunities and improve supply chain operations. Strong analytical skills, attention to detail, and proficiency in procurement software are essential. Typically requires 2–4 years of experience in procurement, supply chain, or a related field.
I’ve tried it with the job descriptions you posted and it works. It doesn’t explicitly discriminate between very granular data such number of years of experience. Could you post a corporate job description which is ostensibly very different from the benchmarks?
Would these be helpful:
Purchasing Coordinator
The Purchasing Coordinator supports the procurement process by managing purchase orders, tracking shipments, and maintaining supplier records. This role ensures timely delivery of materials, resolves order discrepancies, and assists in vendor communications. Strong organizational skills and attention to detail are essential for maintaining accurate purchasing documentation. Typically requires an associate degree or equivalent experience, with 1–3 years of experience in purchasing, supply chain, or administrative support.
IT Support Specialist
Provides technical assistance to employees by troubleshooting hardware, software, and network issues to ensure smooth daily operations. This role is responsible for installing and configuring computer systems, maintaining IT assets, and assisting with cybersecurity best practices. Strong problem-solving skills, attention to detail, and customer service abilities are essential. Typically requires an associate degree in information technology, computer science, or a related field (or equivalent experience) and 1–3 years of experience in IT support or help
Sales & Marketing Assistant
The Sales & Marketing Assistant supports the sales and marketing teams by coordinating promotional activities, managing customer inquiries, and assisting with market research. This role helps create marketing materials, tracks sales data, and maintains customer databases to support business development efforts. Strong communication, organizational, and multitasking skills are essential. Typically requires an associate or bachelor’s degree in marketing, business administration, or a related field, with 1–3 years of experience in sales support, marketing, or administrative roles.
Are these corporate or benchmark job descriptions?
Those are Corporate job descriptions.
Here’s a more complete workflow. It reads job descriptions from separate Benchmark and Corporate workbooks. Since I have very few job descriptions, in this test implementation I put all of the job descriptions in both workbooks. This allowed comparing a job description to itself to assure the the similarity index = 1.0. It did. The Levenshtein distance algorithm is employed to compute the similarity index. I’ll leave to you to decide whether the comparisons are meaningful for your purpose. Note that the two procurement analyst job descriptions from the benchmarks are pretty similar while neither is very similar to the corporate job description. Similarity analysis makes no judgments about which of two compared texts is better.
Levenshtein distance - Wikipedia.
Job Description Comparison rev 2 – KNIME Community Hub
2 Likes
Have you tried the latest workflow I uploaded?
First, let me say how much I appreciate the work you put into this. I did try the revised workflow, and I am not sure its working as needed. Your example above should have yield higher similarity.
I think I need some deeper analysis of the content to determine relatedness, not just similarity of the text. Hence my original question about using ChatGPT or some other NLP tool that interprets the text.
Again, thanks so much for all your efforts on this.
I think you’re right. The classic similarity algorithms are deterministic. Here’s what I got from ChatGPT 4o and Deepseek R1. There are a bazillion AI algorithms. Others might be better. I’m not an expert.
ChatGPT
First of two levels of professional roles supporting the organization’s procurement function. The job typically requires a bachelor’s degree and 2+ years of experience. Analyzes and optimizes purchasing processes to achieve cost-effective sourcing and efficient supply chain management. Conducts market research and competitive analysis using supply chain intelligence platforms to enhance procurement strategies and reporting. Designs and maintains procurement dashboards and reports, ensuring uniform access to critical data. Evaluates suppliers, gathers and analyzes RFP/RFQ responses, and assists in negotiating contracts that meet the organization’s cost, quality, and compliance standards. Collaborates on inventory and cost forecasting, supporting the organization with budget management and adherence to corporate purchasing policies. Works under general supervision within established guidelines.
A Procurement Analyst is responsible for analyzing purchasing data, supplier performance, and market trends to optimize procurement strategies and cost efficiency. This role involves evaluating contracts, negotiating terms, and ensuring compliance with company policies and industry regulations. The analyst collaborates with internal teams to identify sourcing opportunities and improve supply chain operations. Strong analytical skills, attention to detail, and proficiency in procurement software are essential. Typically requires 2–4 years of experience in procurement, supply chain, or a related field.
ChatGPT said:
The two job descriptions are quite similar in their core responsibilities and required skills, but they have some differences in emphasis and detail. Here’s a comparison:
Similarities:
- Procurement Focus: Both roles involve procurement strategy, supplier evaluation, contract negotiation, and compliance with policies.
- Data Analysis & Optimization: Both emphasize analyzing purchasing data, supplier performance, and market trends to improve cost efficiency.
- Collaboration & Communication: Each role involves working with internal teams to enhance sourcing opportunities and supply chain management.
- Experience Requirement: Both require a similar level of experience (2+ or 2–4 years).
Differences:
- Level of Detail:
- The first description provides a more structured breakdown of responsibilities, including dashboards, forecasting, and budget management.
- The second description is broader and more general, focusing on key tasks like contract evaluation and supplier performance.
- Technical Requirements:
- The first mentions procurement dashboards, supply chain intelligence platforms, and competitive analysis, which suggests a stronger emphasis on data tools.
- The second description highlights procurement software proficiency but does not specify tools or platforms.
- Supervision & Work Style:
- The first role is stated to work under general supervision with established guidelines.
- The second does not specify the level of autonomy but implies independence in tasks.
Overall Similarity:
They describe essentially the same role, but the first description is more detailed and structured, while the second is more concise and focused on key skills. If assessing for duplication or redundancy in job postings, these could likely be merged with minor adjustments.
Would you like a rewritten version combining the best aspects of both?
Deepseek R1
How similar are these two job descriptions? First of two levels of professional roles supporting the organization’s procurement function. The job typically requires a bachelor’s degree and 2+ years of experience. Analyzes and optimizes purchasing processes to achieve cost-effective sourcing and efficient supply chain management. Conducts market research and competitive analysis using supply chain intelligence platforms to enhance procurement strategies and reporting. Designs and maintains procurement dashboards and reports, ensuring uniform access to critical data. Evaluates suppliers, gathers and analyzes RFP/RFQ responses, and assists in negotiating contracts that meet the organization’s cost, quality, and compliance standards. Collaborates on inventory and cost forecasting, supporting the organization with budget management and adherence to corporate purchasing policies. Works under general supervision within established guidelines. A Procurement Analyst is responsible for analyzing purchasing data, supplier performance, and market trends to optimize procurement strategies and cost efficiency. This role involves evaluating contracts, negotiating terms, and ensuring compliance with company policies and industry regulations. The analyst collaborates with internal teams to identify sourcing opportunities and improve supply chain operations. Strong analytical skills, attention to detail, and proficiency in procurement software are essential. Typically requires 2–4 years of experience in procurement, supply chain, or a related field.
The two job descriptions are quite similar, with both roles focusing on procurement analysis, cost optimization, and supply chain management. Here’s a breakdown of their similarities and minor differences:
Similarities:
- Core Responsibilities:
- Both roles involve analyzing procurement processes, supplier performance, and market trends to optimize strategies and achieve cost efficiency.
- Both emphasize evaluating contracts, negotiating terms, and ensuring compliance with organizational policies and standards.
- Collaboration with internal teams to improve supply chain operations is a key aspect of both roles.
- Skills and Tools:
- Both require strong analytical skills, attention to detail, and proficiency in procurement-related tools or software.
- Both roles involve working with data, reporting, and ensuring compliance with procurement policies.
- Experience and Qualifications:
- Both positions typically require 2+ years of experience in procurement, supply chain, or a related field.
- A bachelor’s degree is implied or explicitly mentioned as a requirement.
- Focus on Cost and Efficiency:
- Both roles aim to achieve cost-effective sourcing and efficient supply chain management.
Differences:
- Level of Detail:
- The first description provides more specific details about tasks, such as designing and maintaining procurement dashboards, conducting market research using supply chain intelligence platforms, and collaborating on inventory and cost forecasting.
- The second description is more concise and general, focusing on broader responsibilities like analyzing purchasing data and improving supply chain operations.
- Supervision and Guidelines:
- The first description explicitly mentions that the role works under general supervision within established guidelines, which is not mentioned in the second description.
- Experience Range:
- The first description specifies “2+ years of experience,” while the second description mentions “2–4 years of experience,” indicating a slightly broader range.
- Reporting and Data Access:
- The first description highlights designing and maintaining procurement dashboards and ensuring uniform access to critical data, which is not explicitly mentioned in the second description.
Conclusion:
The two job descriptions are highly similar, with overlapping responsibilities, required skills, and qualifications. The differences lie mainly in the level of detail and specificity, with the first description being more granular about tasks like dashboard design and market research. Overall, both roles align closely in purpose and function, with minor variations in emphasis.
New chat