Evaluating Procedures, Products, or Programs: Considerations for Audiologists and Speech-Language Pathologists

When deciding whether to use a procedure, purchase a product, or attend an educational program, the following information will guide you in your clinical practice and support the expansion of your professional knowledge.

Stated Uses of a Procedure, Product, or Program

You should clearly be able to determine the product or tool’s uses and expected outcomes, and ascertain its reliability. You need to be confident the procedure, product, or program will work consistently with repeated use. ASHA members and certificate holders, including applicants for certification, are bound by the ASHA Code of Ethics. The Code states that “Individuals who hold the Certificate of Clinical Competence shall evaluate the effectiveness of services provided, technology employed, and products dispensed, and they shall provide services or dispense products only when benefit can reasonably be expected (Principle I, Rule K)".

Use the procedure, product or program with populations for which there are data on its accuracy. If possible, the standardization process should account for the racial, ethnic, and linguistic diversity of the client population with whom it will be used. If no validity data are available, you must be able to justify use of the procedure and note limitations to generalization with non-validated populations.

You should know and understand if any personal data will be collected and stored—having this knowledge will help you make informed decisions about potential risks. This will help you inform your clients, patients, or students about their options.

Evidence and Outcomes

Peer-reviewed research published in a professional journal assists in determining the reliability and validity of a treatment procedure or product. When reviewing research, consider the quality of the research design (e.g., use of control groups, clear specification of subject characteristics before and after treatment, replication) and the level of evidence. The most credible research is peer-reviewed, is replicated, and demonstrates benefits to the client.

The developer or manufacturer should clearly state expected outcomes. Their supporting data should demonstrate the benefit to the target population. Claims they publish online—including on social media or in promotional materials—should be supported by more than anecdotes and client reviews; look for evidence to back up their assertions or claims.

Avoid unproven or misleading claims, and evaluate procedures, products, or programs with a critical eye. Educating clients, colleagues, and other professionals to recognize warning signs that help distinguish science from pseudoscience is our responsibility.

These warning signs often include the following:

The promoter’s claims sound too good to be true. Remember: Extraordinary treatment claims require extraordinary evidence.

The author describes treatment outcomes in vague, “feel-good” terms—rather than according to well-defined conditions that describe the positive limits of the treatment’s benefits. Be wary of promoters that dismiss, ignore, or distort findings that question their treatment’s supposed benefits, such as claiming that the client or the professional is at fault—and that fault cannot be traced back to a flaw in their approach. Instead, focus on evidence-based interventions that will provide optimal outcomes.

ASHA has completed systematic reviews evaluating the evidence available in multiple topic areas that might help you make informed choices. Here are supporting ASHA resources:

Research the Developer

Research the background of the organization that developed the procedure, product, or program—this is such an important step. A developer’s credentials do not necessarily determine the value of a procedure, product, or program. However, the developer’s background and experience can indicate their knowledge and expertise. In addition to checking the developer’s professional background, look for company certifications or company membership in industry associations—or find information that may indicate compliance with regulatory standards.

Similarly, a new company may be able to develop a high-quality procedure, product, or program. Other, longer-standing companies may have more credibility. Research the reputation of the company by using sources such as the Better Business Bureau, other reliable sources, or “word of mouth.”

Do a Comparison, and Get Feedback From Users

Explore similar procedures, products, or programs that share relevant data—doing so can help you get a better sense of the procedure, product, or program. Also, confer with trusted colleagues who have user experience and quality outcomes. Such colleagues can provide insights into actual use from their unique, experience-informed perspective.

Use available networking platforms such as the ASHA Online Community, Facebook, LinkedIn, Bluesky, X, and Instagram. Look for reviews that both confirm and refute the majority opinion—this may help you make an informed consumer choice. Consult The ASHA Leader and ASHA’s blog, LeaderLive, as other trusted sources of information.

Engage in Self-Reflection and Research

When embarking in one specific area of clinical practice, consider this: Is it within your training, experience, and competence to use the procedure, product, or program?

The ASHA Code of Ethics states that ASHA certificate holders may offer only those services that they are competent to provide—considering their education, training, and experience (Principle II, Rule A). Additionally, certificate holders must evaluate the effectiveness of any service or procedure and use such a service or procedure only when benefit to the client can reasonably be expected (Principle I, Rule K).

Determine Requirements to Implement a Procedure, Product, or Program

The ASHA Code of Ethics requires that “individuals shall provide all clinical services and scientific activities competently” (Principle I, Rule A). Clinicians and their supervisor, director, or administrator must determine how a clinician attains and maintains an appropriate level of competency.

Clinicians may identify coursework that improves knowledge and skills in an area of practice. Some course providers offer a certificate for successfully completing a course. They may require completion of the course and subsequent certification to purchase or use the procedure, product, or program. Although these benefits can demonstrate a commitment to deepening knowledge on a topic, the Certificate of Clinical Competence (CCC) identifies an audiologist or speech-language pathologist as a qualified communication sciences and disorders (CSD) professional.

The following ASHA resources can support members in making informed clinical and service delivery decisions:

Questions to Consider

Consider the following questions when thinking about procedures, products, programs, and technology tools.

Procedures

What are the potential risks and adverse consequences?
What are the potential benefits?
What training can a clinician complete in order to be considered sufficiently trained as a qualified user of the procedure?

Products

Is the product Food and Drug Administration (FDA) approved? Has it or its application been changed from its original design/intent as approved by the  FDA or  Underwriter's Laboratory?
What training and technical support are available?
Is there a guarantee, warranty, or return policy?
Are there potential risks/harm associated with this product?
Are there contraindications for specific populations or etiologies?
What is recommended as sufficient training to be considered a qualified user of the product?

Programs

Does the program offer ASHA CEUs? Are they an ASHA-approved provider?
Is the program presented by a credentialed or certified professional?
Does the time allotted seem appropriate for achieving the stated outcomes?
Who is the target audience (e.g., professional background, beginning vs. advanced)?
What is the refund/cancellation policy?
What instructional methods will be used? Will it be interactive or give a hands-on experience?
Is this topic relevant to current practice issues and trends?

See: Tips for Choosing and Evaluating CE Courses

Costs

Is this procedure, product, or program worth the time and money?
Will the procedure, product, or program benefit my patients?

Technology Tools

Is the app or browser extension from a trusted source?
Is the app cost-effective? Will the free version be sufficient, or will in-app purchases be necessary?
Does the technology tool have privacy and safety features for use with my clients?
Do I have the ability to opt out of tracking and data collecting?
What data are collected, especially if those data use artificial intelligence (AI)? What are the data trained on?
Who will pay for the technology tool or software?
How long will I be able to use the technology tool? Will it require regular software updates, or is it available only as a subscription?
Can I use the technology tool with more than one client?

ASHA would like to thank Patrick Finn, PhD, CCC-SLP and Alison Morrison, Au.D., CCC-A—from the University of Georgia, Department of Communication Sciences and Special Education—for their review of and suggestions for this resource.