Category Archives: Let’s Talk about Research

Let’s Talk About Research IV: Finding the Research

Avoiding the Research Rabbit Hole

Most beginning students start poking around in the research literature when they start writing their own monographs and they really have no idea what they are doing.  You can get sucked so far down the research rabbit hole that your productivity plummets,  if you don’t learn how to narrow a search.  * You can do this even pretty easily even if you DO know how to narrow a search. 🙂 *

The best way to do this is to use specific search terms and to limit yourself to the most recent research.  I focus on not using much research that is older than five years and actively avoid using anything older than ten.

I recommend SciCurve to beginners.  It teaches some common research terms while you are poking around, but  the visuals also show connections that will give you some direction in your research. I am not going to fib the aesthetics appeal to me, as well. Below is what shows up if you ask for a report on kava.

Untitled

kavaTo the left is what it looks like when you ask it to show you a map.  Maybe its because I am a visual learner, but I really like this.  Also if you have your Lazy Scholar add-in, every time you click on one of the bubbles, it will look for the full text of the article on the web.

Now-omics is not as pretty but it is specific to the life sciences and it lets you generate a news feed built with only recent research.  I like it for beginners because they can plug in a very broad search term like a particular plant and then use the topics down the side to filter the larger search.

TRIP has a really handy free search function that allows you to frame your search using the PICO mnemonic I mentioned last week.  The following search returned 98 results defined by type, such as ongoing clinical trials, primary research or guidelines.  Untitled picture

 

 

 

 

Spharro is probably my favorite for keeping up with the latest research, though.  You can make “channels” about every plant if you want.  The platform really allows you to narrow down what you see based on  information about authors, journals and MeSH terms you may have seen on SciCurve or TRIP.

This is the point when people ask why I just don’t stick with Pub Med? There are so many reasons I don’t like Pub Med-most of them having to do with its limitations. Those just getting into research aren’t likely to know common medical subject headings (MeSH) or research terms that will produce good search results.  Pub Med also doesn’t give you the ability to search for a single type of literature or ongoing clinical trials, the way TRIP does or only search through the most up-to-date literature the way Nowomics does.  By that I don’t mean the date of publication so much as I mean that often times the versions of the papers offered on  PubMed are not the final version of the publication.

Specific Paper

In my last few posts on research, one thing that should have become clear is that it is really hard to critically assess a study, if you don’t have the whole thing. Using abstracts limits your understanding of the study design and you don’t get to see the concluding discussion. The sites above are going to send you to a lot of papers where everything but the abstract is hidden by a paywall.   Don’t give up though because there are ways around that, sometimes.

The first thing  I like to suggest is installing the Chrome add-on Lazy Scholar. It is useful for looking for full text versions of a  paper and it will suggest alternative titles that might be related to your research. If you hit Cite, it sends the citation to your clipboard for pasting into a document. My favorite thing about it is the nifty little option that lets me block non-scholarly sites on the Internet for one hour. If Lazy Scholar has not worked its magic and located a copy, the next thing to try is an old-fashioned Google Scholar  search using  the title of the article followed by pdf.

If you can’t find it that way, try to determine if you can get some access to online databases through your local library.  Depending on the size of your library,  availability may be limited.  If that is the case, move on to looking to see what your state library offers.  Many of you might not know this is a thing, but your state library will send out a card number to anyone who lives in the state which grants access to their online resources.  What is available varies by state, but here are some examples.

Iowa
South Dakota
Kansas

Finally, check around some of the places where researchers are able to post their own research for sharing.

Researchgate
Academia
Scribd
PubPeer
Peer Evaluation
ScienceOpen

I think this will wrap up what I have to say about research for right now unless readers have questions.  I am very much involved in my own research projects right now as I am updating my class outlines for the MIdwest Herb Fest and Traditions in Western Herbalism Conference with the most recent information I can find.

Let’s Talk About Research III: Clinical Appraisals

Stephany Hoffelt Iowa City HerbalistsOften students in medical and nursing programs are asked are asked to write up a clinical appraisal of a research study. The first step to doing this is to summarize the study using the PICO mnemonic.  This is a method which biomedical researchers are taught to formulate good clinical questions which can also be used to evaluate research papers.  Using this method is going to be most useful if you have solid knowledge of biological sciences and some sort of clinical experience.

Keep in mind here that  while you are trying to assess how well put together the study is, ultimately what you want to figure out is how this study is relative to your work.

P—Patient
What are the characteristics of the subject or population?
N=number of subjects.
What is the condition or disease being examined?

I—Intervention or exposure
How did the researchers interact with this subject or population?  Were they treating the condition or observing risk factors?

C—Comparison
Was there is the alternative to the primary intervention, for example a placebo or were two interventions being compared?  Were two different populations or being observed?

O—Outcome
What is the relevant outcome- improvement, recovery, remission, death? Did any complications develop? Did the intervention have any side effects.

Now you can move on to critically assessing the study design and outcomes.

What you are looking for here is bias. Bias is a term that is used to used to refer to some sort of partiality on the part of the researchers or the subjects. There are many types of bias. For example, selection bias occurs when potentially eligible subjects are excluded from the study based on interviewer bias.  Ascertainment bias can happening when blinding or masking isn’t done properly and researchers or participants have a certain expectation of the intervention.

Sometimes bias is hard to determine. Publication bias occurs internally when editors of  journals favor studies that come to their preferred conclusions.

Are the Methods Valid?

Was the initial research question clear and impartial?  Do the researchers have a hidden agenda- possibly motivated by marketing motives or keeping their funding.  This is sometimes called the vested interest bias.

Was the sample of subjects clearly defined and representative of what you might encounter in clinical practice?

Were the subjects’ prognosis similar?  Their clinical characteristics need to be similar enough to draw valid conclusions. Were they all from a similar demographic, at a similar stage in a disease? If there was co-morbidity were the coinciding conditions similar?   What are possible confounding variables which means could other factors have contributed to the outcome?

Is the intervention reasonable?   When looking at studies about herbs, we absolutely have to determine if the dosage is one a human can even attain without eating a whole tree.

Was the follow-up sufficiently complete?  Did the study follow at least 80% of the patients through to recovery or an alternate disease outcome such as remission or death?

Were objective and unbiased outcome criteria used?  This means was there some sort of mechanism incorporated into the study such as a standardized pain scale which eliminate the use of subjective conclusions on the part of the researchers as to subjects’ improvement.

What Are the Results?

Does there appear to be any selective reporting on the part of the researchers?

If this is a cohort study were the outcomes and exposures to risk factors assessed similarly.

How likely are the outcomes over time? You might see a  relative risk ratio mentioned in RCT’s and prospective studies.   In retrospective studies, they will mention the odd-ratio.

How logical and accurate are the researcher’s conclusions?  What is the confidence interval- that is the measure of how likely you would be to achieve the same results if you repeated the study?

How Can I Apply the Results to Care of Clients?

Were the study subjects  and methods of management similar to those in my practice?  Can I apply these results to interventions I use with clients in my practice?

You can also look to see who funded the study and whether or not the researchers declared any conflicts of interest, but honestly there are a lot of ways to hide that information.

After you ask yourself all these questions you can summarize the study by listing its strengths and limitations.

Why Talk About Research? Risk Analysis

165

 

 

 

 

 

 

 

I probably should have written to preface my research series, but it just came up for me today due to a conversation I was involved in.  In this post, I am simply fleshing out a hurried reply to that conversation.

I keep up with the research so I can help my clients make good choices.  Ultimately, I may suggest traditional methodology and plant agents, but when I do I make sure I can support my recommendations with anecdotal, historical and modern information.  That includes knowing if a plant preparations has side effects, drug interactions or is a risk in any way.

There have been several conversations on Facebook recently about whether or not certain herbs contain certain substances and what the risks are to that. The number of people who get caught up  arguing that a plant is “safe” in these  conversation always surprises me.

Of course plant preparations may be toxic. Hell water can be toxic, if you drink too much of it. Many really potent herbal medicines are dangerous to our health, if taken in excess. So are many pharmaceuticals-probably most of them to be honest.  Healers have always understood the notion that many times they are using a poison to provoke a healing response.  We’ve known that for centuries, if not millennia.

“All substances are poisonous, there is none that is not a poison; the right dose differentiates a poison from a remedy.”  — Philippus Aureolus Paracelsus

Toxic phytochemicals are not some fairytale made up by the drug companies to discredit herbal medicine.

More frequently  the drug companies have isolated and synthesized these poisons and turned them into medicines like morphine.

To my way of thinking though as a community we are are getting stuck in this somewhat futile stalemate and not moving on to discuss what to do with this information.

So let’s move on….

When you propose a research study in college, you have to go through a process known as IRB. One of the things that they ask you to do is a risk analysis.  This is a valuable tool for most people really, as it is just a form of critical thinking informed by three questions:

What are the risks of a potential intervention?

Risk refers  to the combination of the probability and magnitude of some future harm. So basically what we are asking is:  “What could happen?  How likely is this to happen? and How bad will it be if it does happen?  (Some of this involves critical assessment of the research, also)

What are the benefits of a potential intervention?

It is kind of  a given that we are looking at interventions which result in improvement of health.  That isn’t the question we need to ask ourselves here.  What we really want to ask are more specific questions like:

How likely is it that this intervention will achieve the desired results?
How  dramatically will the intervention improve quality of life?

Are the risks reasonable in relation to anticipated benefits?

Ideally we want our risks to be minimal.  If something has greater than minimal risk I then move on to ask questions about how to reduce the risk:

How was it prepared and administered in traditional practice?  – Using more concentrated forms  of plant medicine (like tinctures and essential oils) requires that we adjust our thinking about the safety of these preparations.

Is a preparation less risky if made with a certain part of the plant, or a certain species?

Can using a low dose minimize the risks?

Is there an there an alternative intervention that has less risk?

MD’s and nurses are taught to go through a similar process when prescribing pharmaceutical medicines or some other therapy. I am not saying they do it, but they are generally taught that this is the responsible way to frame your recommendation.

Granted herbal practitioners don’t have quite so much pressure on us.  We are simply educating clients as to ways phytochemicals could improve their quality of life and support their health- not prescribing life altering chemical agents.

But is still our responsibility to provide clients with the best education possible. This brings us to the importance of knowing the research.  How are we going to be reasonably sure that the benefits outweigh the risks if we blindly turn an eye to the risks?

IMG_8486No one can promise anyone a completely safe intervention.  If a practitioner is telling you that plants are “nature’s medicine” and harmless, stop seeing that person immediately and find someone who knows what they are talking about.

A good healer has done their research and understands  risk analysis.  That is one of our most important jobs.  We mediate between the plant world and the human world through many different ways of knowing. There is no wisdom in stubbornly clinging to one way of knowing.

Sometimes I deem an intervention to be too risky for a certain client and don’t mention it. You pretty much have to apprentice with me before I will talk about some of my great-grandma’s  poisons

I generally present clients with a few options explaining the risks and benefits of each option, because the final decision rests with the client. I educate my clients with all of the information at my disposal about a plant preparation–anecdotal, historical and modern research—so they can make their own informed decisions.