AI-Complaint-Document-Assistant - Revision history

Waghanna at 00:35, 14 June 2024

2024-06-14T00:35:27Z

← Older revision		Revision as of 00:35, 14 June 2024
Line 79:		Line 79:

	'''Additional information:'''		'''Additional information:'''
	Another version of this AI Assistant accepts complaint descriptions from a user interface prompt allowing for complaint assessments in real-time or research use. See [[AI-Complaint-Assistant ~~with prompt~~]] for more info.		Another version of this AI Assistant accepts complaint descriptions from a user interface prompt allowing for complaint assessments in real-time or research use. See [[AI-Complaint-Prompt-Assistant]] for more info.

Waghanna: Waghanna moved page AI-Complaint-Assistant for document to AI-Complaint-Document-Assistant without leaving a redirect

2024-06-14T00:30:59Z

Waghanna moved page AI-Complaint-Assistant for document to AI-Complaint-Document-Assistant without leaving a redirect

← Older revision	Revision as of 00:30, 14 June 2024
(No difference)

Waghanna: /* App Description */

2024-04-15T21:57:34Z

App Description

← Older revision		Revision as of 21:57, 15 April 2024
Line 62:		Line 62:
	==App Description==		==App Description==

	'''Use ~~case~~:'''		'''App Use Case:'''
	The AI-Complaints-Assistant streamlines complaint assessments using AI to apply a medical device reportability engine, which offers predictive scoring to determine if a complaint is reportable, sparing manual research of MAUDE records. It optimizes resource usage and prioritizes RA/QA review for timely MDR submissions by assessing the likelihood of FDA reportability based on MAUDE history, rather than just matching data. In addition it also creates pre-populated FDA Form 3500 forms for complaints with high reportability scores, to further expedite the process and improving efficiency. This AI Assistant accepts complaint descriptions from locally provided PDF or Word documents, as well as from network locations. Additionally, it can operate in batch mode, processing one or more documents within a specified folder path defined in the Settings file, automatically including documents from sub-folders, to allow for a retrospective assessment of old complaint records.		The AI-Complaints-Assistant streamlines complaint assessments using AI to apply a medical device reportability engine, which offers predictive scoring to determine if a complaint is reportable, sparing manual research of MAUDE records. It optimizes resource usage and prioritizes RA/QA review for timely MDR submissions by assessing the likelihood of FDA reportability based on MAUDE history, rather than just matching data. In addition it also creates pre-populated FDA Form 3500 forms for complaints with high reportability scores, to further expedite the process and improving efficiency. This AI Assistant accepts complaint descriptions from locally provided PDF or Word documents, as well as from network locations. Additionally, it can operate in batch mode, processing one or more documents within a specified folder path defined in the Settings file, automatically including documents from sub-folders, to allow for a retrospective assessment of old complaint records.

	'''~~Model description~~:'''		'''App Functionality:'''
	The AI-Complaints-Assistant is designed to accept complaint descriptions from specified file source, which may include natural language describing customer complaints and any relevant references to device models, usage settings, troubleshooting information, and other related details. Additionally, it reads a Settings file containing MAUDE query parameters, such as product problem codes, patient problems and outcomes, date ranges, and various other fields, along with prompts used for different processing steps in the similarity evaluation. The predictive reportability scores are influenced by factors such as the device problem code, patient problems and outcomes, the estimated severity of potential harm and other attributes specified in the Settings file.		The AI-Complaints-Assistant is designed to accept complaint descriptions from specified file source, which may include natural language describing customer complaints and any relevant references to device models, usage settings, troubleshooting information, and other related details. Additionally, it reads a Settings file containing MAUDE query parameters, such as product problem codes, patient problems and outcomes, date ranges, and various other fields, along with prompts used for different processing steps in the similarity evaluation. The predictive reportability scores are influenced by factors such as the device problem code, patient problems and outcomes, the estimated severity of potential harm and other attributes specified in the Settings file.

Waghanna at 19:22, 15 April 2024

2024-04-15T19:22:18Z

← Older revision		Revision as of 19:22, 15 April 2024
Line 6:		Line 6:
	Reference file: [[Media: openFDA device_search_fields.xlsx]]		Reference file: [[Media: openFDA device_search_fields.xlsx]]

	{\| role="presentation" class="wikitable mw-collapsible mw-collapsed"		{\| role="presentation" style="min-width:250px;" class="wikitable mw-collapsible mw-collapsed code-sample"
	\| <strong>Settings.txt </strong>		\| <strong>Settings.txt </strong>
	\|-		\|-

Waghanna at 18:15, 13 April 2024

2024-04-13T18:15:57Z

← Older revision		Revision as of 18:15, 13 April 2024
Line 1:		Line 1:
	~~'''Use case:'''~~
	The AI-Complaints-Assistant streamlines complaint assessments using AI to apply a medical device reportability engine, which offers predictive scoring to determine if a complaint is reportable, sparing manual research of MAUDE records. It optimizes resource usage and prioritizes RA/QA review for timely MDR submissions by assessing the likelihood of FDA reportability based on MAUDE history, rather than just matching data. In addition it also creates pre-populated FDA Form 3500 forms for complaints with high reportability scores, to further expedite the process and improving efficiency. This AI Assistant accepts complaint descriptions from locally provided PDF or Word documents, as well as from network locations. Additionally, it can operate in batch mode, processing one or more documents within a specified folder path defined in the Settings file, automatically including documents from sub-folders, to allow for a retrospective assessment of old complaint records.

	~~'''Model description:'''~~
	The AI-Complaints-Assistant is designed to accept complaint descriptions from specified file source, which may include natural language describing customer complaints and any relevant references to device models, usage settings, troubleshooting information, and other related details. Additionally, it reads a Settings file containing MAUDE query parameters, such as product problem codes, patient problems and outcomes, date ranges, and various other fields, along with prompts used for different processing steps in the similarity evaluation. The predictive reportability scores are influenced by factors such as the device problem code, patient problems and outcomes, the estimated severity of potential harm and other attributes specified in the Settings file.

	In cases where there are no similar records found for the complaint input, expanding the MAUDE search to include additional device codes under the same regulation number is possible with a small change in the Settings file. This approach opens up possibilities for broader analysis and leads to more comprehensive insights.

	~~Using the MAUDE query results, the AI Assistant matches the top problems similar to the provided complaint, reporting the estimated similarity for each along with relevant reference information.~~

	~~Diagram outlining the processing steps of the Complaints Assistant:~~

	~~[[Image: AI-Complaint-Handling-Process.jpg\|800px]]~~

	A PDF document is generated containing results detailing the top product problems associated with the specified product code, along with additional analytics for each product problem. It also includes the highest matching Medical Device Reports (MDRs) with estimated similarity scores and detailed explanations for their similarity.

	~~'''Additional information:'''~~
	Another version of this AI Assistant accepts complaint descriptions from a user interface prompt allowing for complaint assessments in real-time or research use. See [[AI-Complaint-Assistant with prompt]] for more info.

	==App Files==		==App Files==

Line 78:		Line 59:

	'''[[Sample Files: AI-Complaint-Assistant for document]]'''		'''[[Sample Files: AI-Complaint-Assistant for document]]'''

			==App Description==

			'''Use case:'''
			The AI-Complaints-Assistant streamlines complaint assessments using AI to apply a medical device reportability engine, which offers predictive scoring to determine if a complaint is reportable, sparing manual research of MAUDE records. It optimizes resource usage and prioritizes RA/QA review for timely MDR submissions by assessing the likelihood of FDA reportability based on MAUDE history, rather than just matching data. In addition it also creates pre-populated FDA Form 3500 forms for complaints with high reportability scores, to further expedite the process and improving efficiency. This AI Assistant accepts complaint descriptions from locally provided PDF or Word documents, as well as from network locations. Additionally, it can operate in batch mode, processing one or more documents within a specified folder path defined in the Settings file, automatically including documents from sub-folders, to allow for a retrospective assessment of old complaint records.

			'''Model description:'''
			The AI-Complaints-Assistant is designed to accept complaint descriptions from specified file source, which may include natural language describing customer complaints and any relevant references to device models, usage settings, troubleshooting information, and other related details. Additionally, it reads a Settings file containing MAUDE query parameters, such as product problem codes, patient problems and outcomes, date ranges, and various other fields, along with prompts used for different processing steps in the similarity evaluation. The predictive reportability scores are influenced by factors such as the device problem code, patient problems and outcomes, the estimated severity of potential harm and other attributes specified in the Settings file.

			In cases where there are no similar records found for the complaint input, expanding the MAUDE search to include additional device codes under the same regulation number is possible with a small change in the Settings file. This approach opens up possibilities for broader analysis and leads to more comprehensive insights.

			Using the MAUDE query results, the AI Assistant matches the top problems similar to the provided complaint, reporting the estimated similarity for each along with relevant reference information.

			Diagram outlining the processing steps of the Complaints Assistant:

			[[Image: AI-Complaint-Handling-Process.jpg\|800px]]

			A PDF document is generated containing results detailing the top product problems associated with the specified product code, along with additional analytics for each product problem. It also includes the highest matching Medical Device Reports (MDRs) with estimated similarity scores and detailed explanations for their similarity.

			'''Additional information:'''
			Another version of this AI Assistant accepts complaint descriptions from a user interface prompt allowing for complaint assessments in real-time or research use. See [[AI-Complaint-Assistant with prompt]] for more info.

Waghanna at 21:14, 11 April 2024

2024-04-11T21:14:44Z

← Older revision		Revision as of 21:14, 11 April 2024
Line 22:		Line 22:
	<blockquote>		<blockquote>
	Application executable: [[Media: AI-Complaint-Assistant-Document.zip]]		Application executable: [[Media: AI-Complaint-Assistant-Document.zip]]

	~~Reference file: [[Media: ComplaintAssessmentDocument-Schema.zip]]~~

	Reference file: [[Media: openFDA device_search_fields.xlsx]]		Reference file: [[Media: openFDA device_search_fields.xlsx]]

Waghanna at 21:52, 7 April 2024

2024-04-07T21:52:40Z

← Older revision		Revision as of 21:52, 7 April 2024
Line 28:		Line 28:

	{\| role="presentation" class="wikitable mw-collapsible mw-collapsed"		{\| role="presentation" class="wikitable mw-collapsible mw-collapsed"
	\| <strong>Settings.txt</strong>		\| <strong>Settings.txt </strong>
	\|-		\|-
	\|		\|

Waghanna at 21:39, 7 April 2024

2024-04-07T21:39:01Z

← Older revision		Revision as of 21:39, 7 April 2024
Line 78:		Line 78:
	----		----
	See the sample files page for example settings and reports.		See the sample files page for example settings and reports.

	'''[[Sample Files: AI-Complaint-Assistant for document]]'''		'''[[Sample Files: AI-Complaint-Assistant for document]]'''

Waghanna at 21:36, 7 April 2024

2024-04-07T21:36:13Z

← Older revision		Revision as of 21:36, 7 April 2024
Line 21:		Line 21:

	<blockquote>		<blockquote>
	Application executable: [[~~File~~:AI-Complaint-Assistant-Document.zip]]		Application executable: [[Media: AI-Complaint-Assistant-Document.zip]]

	Reference file: [[~~File~~: ComplaintAssessmentDocument-Schema.zip]]		Reference file: [[Media: ComplaintAssessmentDocument-Schema.zip]]

	Reference file: [[~~File~~: openFDA device_search_fields.xlsx]]		Reference file: [[Media: openFDA device_search_fields.xlsx]]

	{\| role="presentation" class="wikitable mw-collapsible mw-collapsed"		{\| role="presentation" class="wikitable mw-collapsible mw-collapsed"

Waghanna at 21:33, 7 April 2024

2024-04-07T21:33:05Z

← Older revision		Revision as of 21:33, 7 April 2024
Line 19:		Line 19:

	==App Files==		==App Files==
	'''[[~~App~~ Files: AI-Complaint-Assistant for document]]'''
			<blockquote>
			Application executable: [[File:AI-Complaint-Assistant-Document.zip]]

			Reference file: [[File: ComplaintAssessmentDocument-Schema.zip]]

			Reference file: [[File: openFDA device_search_fields.xlsx]]

			{\| role="presentation" class="wikitable mw-collapsible mw-collapsed"
			\| <strong>Settings.txt</strong>
			\|-
			\|
			CONFIG:OpenFDA-Vertex-V1.0 // identifies schema version (readonly)

			https_url1: // openFDA api for source data

			limit1: // limit of query results

			report_title: // title of output report

			data1_fields: // data fields to be analyzed in MDR query results

			KEYWORD1-SEARCH: // general keyword search terms (matched in any field)

			SEARCH1-FIELDS:SEARCH1-TERMS // query search fields and terms, see openFDA device_search_fields.xlsx for full details of searchable fields

			date_received: // example field

			device.device_report_product_code: // example field

			SORT1-FIELD:SORT1-TERM // query results sorting
			date_received:desc

			COUNT1-FIELD:COUNT1-TERM // query count field/term

			AI-ProblemSummaryPrompt: // Prompt that summarizes the product problem

			AI-CountSummaryPrompt: // Prompt that counts the instances of items

			AI-ProblemSimilarityPrompt: // Prompt that summarizes the problem similarity to a product problem

			AI-MDRSimilarityPrompt: // Prompt that analyzes the similarity between input problem and MAUDE results matching query criteria

			AI-ReportSummaryPrompt: // Prompt that summarizes the most similar problems

			AI-WordsPerReport: // Number of words in each intermediate report (recommended: 1500, range: 100-5000)

			AI-ModelTemperature: // LLM Temperature index (recommended: 0.05, range: 0..1f)

			AI-ModelTopP: // LLM TOP_P index (recommended: 0.4, range: 0..1f)

			AI-ModelTopK: // LLM TOP_K number of words for next word prediction (recommended: 10, range: 1-128)

			AI-ModelMaxOutputTokens: // LLM maximum output words (range: 1-2048)
			\|}

			</blockquote>
			----
			See the sample files page for example settings and reports.
			'''[[Sample Files: AI-Complaint-Assistant for document]]'''