- Research
- Open access
- Published:
Building capacity in dissemination and implementation research: the presence and impact of advice networks
Implementation Science volume 19, Article number: 78 (2024)
Abstract
Background
As dissemination and implementation (D&I) research increases, we must continue to expand training capacity and research networks. Documenting, understanding, and enhancing advice networks identifies key connectors and areas where networks are less established. In 2012 Norton et al. mapped D&I science advice and collaboration networks. The current study builds on this work and aims to map current D&I research advice networks.
Methods
D&I researchers in the United States (US) and Canada were identified through a combination of publication metrics, and key persons identified networks and were invited to participate (n = 1,576). In this social network analysis study, participants completed an online survey identifying up to 10 people from whom they sought and/or gave advice on D&I research. Participants identified four types of advice received: research methods, grant, career, or another type (e.g., work/life balance). We used descriptive statistics to characterize the sample and network metrics and visualizations to describe the composition of advice networks.
Results
A total of 482 individuals completed the survey. Eighty-six (18%) worked in Canada and 396 (82%) in the US. Respondents had varying D&I research expertise levels; 14% beginner expertise, 45% intermediate, 29% advanced, and 12% expert. The advice network included 978 connected nodes/individuals. For all research types, out-degree, or advice giving, was higher for those with advanced or expert-level expertise (6.9 and 11.9, respectively) than those with beginner or intermediate expertise (0.8 and 2.2, respectively). Respondents reporting White race reported giving (out-degree = 5.2) and receiving (in-degree = 6.1) more advice compared to individuals reporting Asian (out-degree = 2.9, in-degree = 5.3), Black (out-degree = 2.3, in-degree = 5.2), or other races (out-degree = 2.5, in-degree = 5.4). Assortativity analyses revealed 98% of network ties came from individuals within the same country. The top two reasons for advice seeking were trusting the individual to give good advice (78%) and the individual’s knowledge/experience in specific D&I content (69%).
Conclusions
The D&I research network is becoming more dispersed as the field expands. Findings highlight opportunities to further connect D&I researchers in the US and Canada, individuals with emerging skills in D&I research, and minoritized racial groups. Expanding peer mentoring opportunities, especially for minoritized groups, can enhance the field’s capacity for growth.
Background
The dissemination and implementation (D&I) research field has rapidly expanded over the past decade. During this time, an increasing number of D&I capacity building initiatives have emerged, including graduate certificate programs, PhD training, mentored training programs, and short courses [1,2,3,4]. These initiatives enhance knowledge, skills, and confidence in conducting D&I research and foster the expansion of and engagement in research networks [1, 5]. Mentored training programs typically use a team-based mentoring approach and demonstrate benefits for career development and network expansion. These programs also connect with and contribute to peer-to-peer mentoring (Table 1) [6, 7]. While mentored D&I training programs are highly valued, they require significant time, infrastructure, and leadership to develop [8]. Unfortunately, the demand for such training programs outpaces the current infrastructure, indicating a need for creative solutions to expand D&I capacity [1, 9].
D&I capacity building is further hindered by the relatively limited number of senior, experienced mentors of diverse genders and racial backgrounds [2, 11, 12]. Consequently, peer mentoring has gained recognition as a valuable resource within the growing field of D&I research [10]. Peer mentoring helps individuals connect through shared experiences and career levels, providing an environment where individuals may feel more comfortable seeking advice compared to hierarchical mentoring structures [10]. Trainees in D&I training programs have consistently identified peer mentoring as a key benefit, supporting their network expansion and skill development [6, 13].
While rigorously developed training programs are vital to advancing the field [2], it is also essential to recognize the value of less formal advice-seeking behaviors. Advice seeking complements mentoring and can help advance the field. Individuals training in D&I research report preferences for engaging in mentoring over time in which they can seek advice on an ongoing or as needed basis [8]. Team-based mentoring programs encourage mentees to seek advice from multiple individuals because each individual may present different perspectives on the same work [7]. Particularly in the early career stages, individuals are encouraged to proactively seek advice from others to support their training, career, and scientific development [7].
Despite the importance of advice-seeking [14], and its investigation in other realms of healthcare and research [15,16,17,18], advice-seeking has received limited attention in D&I research. In 2012, Norton and colleagues conducted a survey mapping D&I advice and collaboration networks in the United States [19]. They found that the D&I advice network was sparse and contained many isolates (i.e., individuals who had not given advice to nor received advice from anybody in the network) [19]. Norton et al. also identified individuals who held key positions within the advice network by providing advice to many individuals [19]. Given the growth in the field over the past 10 years, it is important to evaluate how D&I advice networks have developed and evolved.
As a tool for studying advice networks, social network analysis (SNA) supports the investigation of patterns of relationships among individuals [20]. The current study used SNA to investigate D&I advice networks in the United States (US) and Canada. SNA allows researchers to investigate the underlying structure of advice networks, how information is exchanged between individuals and groups, and potential intervention points (e.g., connecting isolated individuals) [6]. Advice networks can encompass mentoring relationships and less formal advice from peers. Documenting current D&I advice networks will identify key connectors in the field and areas where networks are less established. The current study expands Norton et al.’s work [19] by including researchers in the US and Canada. We expanded the sample to Canadian researchers due to Canada’s robust D&I research infrastructure that includes a focus on training and mentorship [8]. This study addressed the following research questions within the US and Canada:
-
1)
How do D&I advice networks differ based on demographic characteristics such as career stage, D&I expertise level, race, and gender?
-
2)
To what extent are D&I researchers in the US and Canada connected?
-
3)
What factors contribute to advice-seeking?
-
4)
Within the network of those engaged in D&I research in the US and Canada, from whom do members most frequently seek advice on D&I related work?
Methods
This cross-sectional SNA study aimed to examine D&I advice networks in the US and Canada. Study participants completed an online survey using Qualtrics between April 2023 and July 2023. Throughout all study procedures, the terms dissemination, implementation, and knowledge translation/knowledge mobilization were used and defined due to the different terminology used in the US and Canada [21, 22]. For this paper, we use the term D&I for simplicity. This study adhered to the Social Networks in Health Research reporting guidelines [23]. The Institutional Review Board at Washington University in St. Louis approved this study as exempt research.
Sampling approach and network boundaries
The study sample was defined through a combination of publication metrics and a key person identified network. We sought to include individuals across career stages including trainees and established D&I researchers.
To identify the sample of individuals engaged in D&I research we started with individuals who published in one or more of five core D&I journals between January 2018 through December 2022. We pulled the names of the first, last/senior, and/or corresponding authors on all publications, including those with affiliations in the US or Canada. We considered these individuals as the primary contributors to the work and most likely to be engaged in D&I research. We chose not to include all authors because this may have artificially inflated the sample. Core D&I journals included: Implementation Science, Implementation Science Communications, Frontiers in Health Services- Implementation Science section, Global Implementation Research and Application, and Implementation Research and Practice. We added Journal of Clinical Epidemiology as it is a common dissemination channel for knowledge translation research in Canada. Keyword title searches using the terms dissemination, implementation, knowledge translation, and knowledge mobilization were used to identify potentially relevant articles/authors within the Journal of Clinical Epidemiology.
The team also identified core D&I faculty and trainees from US and Canada-based Universities from Huebschmann et al.’s (2022) work outlining implementation science capacity building programs [3]. We confirmed the sample included Editorial board members of core D&I journals and members of the main study section that reviews most D&I research applications at the National Institutes of Health [24]. To identify additional researchers in Canada, we searched the following sources: (1) the Canadian Institutes for Health Research trainee database (2) KT Canada Scientific Meeting abstracts and speakers (3) Canadian Association for Health Services and Policy Research Annual Meeting abstracts (4) Center for Implementation Research at Ottawa Hospital (5) University of Toronto Knowledge Translation program, and (6) University of Manitoba knowledge translation and synthesis services. The study lead (AL) and a D&I expert (RB) reviewed trainee scientific synopses and abstracts to assess involvement in D&I research. We limited trainee and abstract searches to 2018 through 2022. The study team reviewed the sample; they added seven individuals and removed 23.
Network operationalization
Each node, or circle on the network map, represents one individual in the network. Nodes are color-coded based on a participant characteristic (e.g., country, D&I expertise). The size of each node corresponds to the overall out-degree, or the number of individuals to whom somebody gave advice. A tie connects two nodes if one or both individuals reported giving advice to or receiving advice from the other; Fig. 1 presents a theoretical directed network. These ties are directed because they go to/from one node to another [25]. This study examines a whole, one-mode network [25] of individuals engaged in D&I research.
Theoretical directed network. This theoretical network displays the bi-directional nature of data collection. Each circle, or node/individual, is labeled with a letter-#, where the number indicates the individual’s out-degree value. For example, A-2 indicates person A gave advice to two other individuals. All gray arrows indicate the node of origin reported giving advice to the end node (e.g., C reported giving advice to D). All red arrows indicate the end node reported receiving advice from the origin node (e.g., A reported receiving advice from H). Individuals received a tally for their out-degree when they reported giving advice to an individual and when an individual reported receiving advice from them, which is considered bi-directional data
Data collection
Participants were emailed a personalized survey link and invited to complete a 10- to 15-min online survey using Qualtrics. The survey invitation was sent from a general D&I working group email via Qualtrics with the goal of not biasing respondents. Eligible individuals who did not respond to the survey were emailed up to four reminders one week apart, except for the final reminder, emailed two weeks after the previous reminder. Participants were offered a $20 USD electronic gift card after completing the survey.
Survey questions were informed by Norton et al.’s 2012 D&I network survey [19] and adapted based on team discussions about questions to prioritize based on how the field has evolved over the last 10 years. We further modified the survey based on feedback from researchers outside the research team with expertise in D&I research and SNA methods. Participants selected names from a pre-populated list of 1,576 individuals, which included the full list of individuals invited to complete the survey. Participants were asked to identify up to 10 people from whom they 1) received advice on D&I research issues and 2) gave advice on D&I research issues within the past two years. The question was limited to the past two years and selecting 10 individuals to support recall accuracy and to reduce respondent burden, particularly for individuals highly engaged in D&I advice networks. Participants had the option to type in the names of other individuals not included on the pre-populated list. For each individual selected, participants identified the type(s) of advice received including research methods (e.g., study design, theories/models/frameworks), grant funding (e.g., identifying funding agency or mechanism, drafting a specific aims page), career advice, or other types of advice. Participants were asked to select their top three reasons for seeking advice from the individuals they identified (e.g., trust, prior experience working together). Participant characteristics (e.g., involvement and experience with D&I research, current job position, race) were self-reported. For the full survey, see Additional file 1.
Missing data
Network data were managed and stored on a secure server and in R version 4.4.1 [26]. Due to the broad boundaries of the network, there was a large amount of missing data from survey non-respondents. These data are included in network analyses because they are considered network members. Individuals who did respond to the survey could still endorse an advice-seeking connection with non-respondents, but bi-directional data were not collected when one individual did not respond. Due to the nature of the research question and large number of non-respondents, imputation was not feasible.
Data analysis
Demographic characteristics were summarized using descriptive statistics. A new variable was created representing each individual’s D&I expertise level based on two survey questions: self-rated level of D&I experience (beginner, intermediate, advanced) and number of years engaged in D&I research (< 2 to > 15). After combining these two variables, D&I expertise level was divided into four categories: beginner, intermediate, advanced, and expert (Table 2). Participants had the option to select ‘other’ when reporting demographic characteristics.
When respondents typed in names not included on the pre-populated list, our team reviewed these responses to assess if the names were included in the original list. When a write-in response was a duplicate of an individual already in the network, these responses were merged with the original sample. Based on write-it responses, we added two individuals to the network. More than ten respondents wrote in the names of these individuals.
Connectedness Based on D&I expertise and demographic characteristics
To describe the network, or to what extent D&I researchers are connected, we explored visualizations (graphs) and common network metrics to describe each of the five networks (any advice, research methods, grant funding, career, and other advice). Metrics calculated included the number of connected actors or nodes, total number of ties or advice given/received, number of isolates or actors without any ties, density, largest component size, average geodesic distance, average degree, and each network’s transitivity or clustering coefficient. These metrics are further defined in the results section. To understand if some groups of researchers differ in the number of advice connections, we examined the average out-degree (number of nodes that were provided advice from one node) for each group (country, expertise, gender, and race) and each of the 5 advice networks with Kruskal–Wallis rank sum tests. We explored the tendency for researchers to connect or form ties with other researchers who share similar characteristics (country, expertise, gender, or race) calculating assortment coefficients and the proportion of within group ties shared [27, 28]. Our goal was to analyze a complete network.
Reasons people seek advice
To understand what factors contribute to advice-seeking, we examined differences between participant characteristic (experience level, gender, race) by advice reason type with chi-square tests.
Prominent individuals in the D&I advice network
We used out-degree calculations to identify prominent individuals in the D&I advice network. Each individual’s out-degree score was ranked, with those having the highest out-degrees (giving advice to more contacts) ranked for the US and Canada, and for researchers with beginner or intermediate D&I expertise level. All data were cleaned, analyzed and visualized in R version 4.4.1 using the tidyverse, arsenal 3.6.3, igraph 2.0.3, and assortnet packages [26, 29,30,31,32].
Results
A total of 1,576 individuals were invited to participate in the survey via email: 1,221 (77.5%) in the US and 355 (22.5%) in Canada. Of these individuals, 1,518 were eligible to participate and 482 completed the full survey (response rate = 32%); 396 (82%) respondents worked in the US and 86 (18%) in Canada. The distribution of US and Canadian participants is in alignment with the different population sizes of these countries (337 million versus 41 million) [33, 34]. Individuals were considered ineligible to participate when 1) they responded “no” to the initial screening question [(n = 8); have you given or received advice related to D&I research in the past 2 years?], 2) an email address was not publicly available online (n = 102; more than half were based in Canada), 3) an email bounced and another email address was not identified (n = 25), 4) there was an out of office message indicating the person was on leave for the entirety of the study period (n = 20), or 5) an automatic reply email indicated the individual left the institution and there was no forwarding email address (n = 5).
Participants covered a range of professional levels from graduate students (6% of total sample) to full professors (20%). In the US sample, the largest portion of the sample was at the Assistant Professor rank (32%). In the Canadian sample, most individuals identified as ‘Other’ professional rank (22%) or graduate student (15%). Additional demographic characteristics are available in Table 3.
Network metrics
Overall findings reveal a network with relatively low density (0.0014), meaning that there are a large number of individuals in the network who are not connected to each other. Although many individuals in the network are not connected, there is a relatively small average geodesic distance, or number of degrees of separation between individuals, for all advice types (5.39). This means that on average, any individual in the network can reach another individual in the network through about 5 connections or introductions. The average geodesic distance was larger, meaning greater separation, for grant advice (7.96) and was smallest for career advice (3.43). This means people would need to talk with a larger number of their connections to connect with a random individual in the grant advice network compared to the career advice network. The average degree for all advice types is 4.29, indicating the number of ties between nodes in the network. This means that the average individual in the network engaged in advice-related connections with a total of about four individuals. For specific advice types, average degree is highest for research advice (3.6) followed by grants (1.96) and career advice (1.6). Table 4 presents the network metrics for the full sample. Additional file 2 presents network metrics for the United States and Canada cohorts separately.
Network visualizations—advice network maps
Figure 2 depicts advice networks based on level of D&I expertise where each node, or circle, is color-coded based on the individual’s expertise level from beginner to expert. Gray nodes on the map depict individuals who were either invited to participate in the survey and did not respond or those who were not included in the initial sample, or network bounds, but were identified by survey respondents. Although most connections involving gray nodes predominantly consist of connections to single individuals, the research advice map (Fig. 2b) reveals certain instances where gray nodes are more centralized and larger. This pattern indicates advice was provided to several individuals. Overall, these maps demonstrate that advanced and expert-level individuals provide advice to larger numbers of individuals. Further, grant (Fig. 2c) and career (Fig. 2d) advice maps have a larger number of individuals on the periphery who are not connected to the larger network. In Fig. 2d, an example of a zoomed in isolated network is provided. Here, three individuals with advanced D&I expertise are connected to each other and they are further connected to several earlier stage investigators (beginner and intermediate). These individuals have their own small network that is not connected to the broader career advice network. Alternatively, the left center of Fig. 2c provides an example of how individuals on the periphery of the network are still connected to the larger network based on their connection with one individual.
Figure 3 depicts D&I advice networks for the US and Canada where the node color represents each country. These maps demonstrate limited overlap in advice networks between the US and Canada. However, most individuals in the network can be connected through a small number of key individuals. Again, grant and career advice maps are more dispersed with more individuals on the periphery of the map with limited or no connection to the main network. There are relatively few primary connections between individuals in the US and Canada on grant and career advice.
Access to advice (researcher connectedness)
Table 5 presents degree and assortativity statistics. Out-degree represents the number of connections individual (or node) gave advice to, and in-degree represents the number of connections from whom an individual received advice. For all research types, out-degree is much higher for those with advanced or expert-level expertise (6.9 and 11.9, respectively) compared to those with beginner or intermediate-level D&I expertise (0.8 and 2.2, respectively). Interestingly, in-degree is also somewhat higher for advanced (6.9) and expert (6.7) groups compared to beginner (4.4) and intermediate (5.6) groups. Men report giving more advice than women (7.6 versus 3.8 out-degrees, respectively), but they report receiving advice from a similar number of individuals (men in-degree = 6.1, women in-degree = 5.8). However, there were no statistically significant differences in out-degree for all research types by gender based on Kruskal–Wallis rank sum test; H = 3.22, p = 0.07. We observed significant differences based on race. Respondents reporting White race reported giving (out-degree = 5.2) and receiving (in-degree = 6.1) more advice compared to individuals reporting Asian (out-degree = 2.9, in-degree = 5.3), Black (out-degree = 2.3, in-degree = 5.2), or other races (out-degree = 2.5, in-degree = 5.4). Kruskal–Wallis rank sum test revealed statistically significant differences based on out-degree for all research types based on race; H = 12.71, p = 0.01. Post-hoc tests showed differences between Asian and White races were driving the significant racial differences (Z = -2.99, p = 0.028). Across countries, expertise levels, genders, and races, individuals predominantly give and receive the most D&I advice on research initiatives, followed by grants and then career advice.
Assortativity coefficients are interpreted similarly to correlation coefficients (-1 to + 1) where values closer to + 1 indicate a higher tendency for individuals to form ties with other individuals who share the same trait (e.g., county, gender). Assortativity coefficients near zero indicate no tendency either way and larger negative coefficients indicate a tendency to form ties with others who do not share the same trait [27, 28]. Country had the highest assortativity across all advice types (range r = 0.88 to r = 0.93) with more than 95% of all ties in each network shared between researchers from the same country (Table 5). Figure 3 visually depicts the high assortativity within country. For gender, the assortativity coefficients ranged from r = 0.05 to r = 0.11 indicating no inherent tendency for individuals to form ties within their gender groups. Similarly, advice ties within D&I expertise level groups were not present with an assortativity coefficient range of r = 0.03 to r = 0.05. Assortativity by race overall did not show a high tendency to form ties with others within the same racial group (range r = 0.09 to r = 0.20), however, the coefficients were larger in both career (r = 0.15) and other (r = 0.20) advice-type networks indicating individuals may be more likely to form ties within racial groups for advice on career or other types of advice (vs. research and grants). For example, in research and grants networks, 65–66% of all ties were shared between individuals within the same racial group compared to 74% shared in the other advice network. Examples of other advice reported by participants included clinical implementation, capacity building, and maintaining work/life balance.
Reasons for seeking advice
After identifying individuals from whom they sought advice, participants were asked to select the top three reasons they sought advice from these individuals. The most frequently identified reasons were 1) trust that the person would give them good advice (78%), 2) D&I content area knowledge of the individual (69%), 3) the individual is recognized as a successful researcher (42%), and 4) prior experience working together (34%). Group differences are noted in Table 6, with beginners more likely to endorse interest in pursuing similar career paths and desire to be mentored by the individual as reasons for seeking advice (p < 0.02), and less likely to select previously working with the individual as a reason, p < 0.001.
Table 6 outlines advice seeking reasons based on gender and race. Participants endorsed ‘I trust they will give me good advice’ (78%) and ‘they have knowledge/experience in a D&I/KT content area I want to learn more about’ (69%) as the top two reasons for seeking advice from an individual. Beginners (10%) were least likely to endorse ‘we have previously worked together’ as a reason for seeking advice compared to all other expertise levels (32–49%), p < 0.001. White participants were more likely to endorse seeking advice because ‘we have previously worked together’ (38%) compared to Non-White participants (25%), p = 0.01. Participants with beginner or intermediate expertise were more likely to endorse ‘I am interested in pursuing a similar career path to them’ (p = 0.004) and ‘I would like to be mentored by them’ than individuals with advanced or expert-level expertise (p < 0.001).
Key individuals in D&I advice networks
Individuals with the highest out-degree scores provide the most D&I advice. Figure 4 presents an example ego network, representing all the connections of one individual. The ego network depicts the broad impact one individual can have in the D&I advice network across career stages. Individuals with the highest scores for each type of advice are listed in rank order in Table 7, including 10 individuals from the US and 5 from Canada due to the smaller Canadian sample size. Individuals with any level of expertise were eligible for inclusion on the US and Canada lists, but all individuals identified with the highest out-degree scores had advanced or expert-level D&I expertise. Among these individuals, out-degree for all research types ranged from 36–76 for individuals in the US and 12–22 for those in Canada. To identify frequent advice-givers earlier in their D&I research careers we limited the sample to individuals with beginner or intermediate D&I expertise and identified the individuals with the highest out-degree scores, these individuals are also identified in Table 7 (out-degree range for all advice: 12–13). For the presented rankings, D&I expertise level was based on the combined variable of self-rated expertise level and number of years of D&I experience. Some individuals who are more established in their overall research careers are included on the beginner/intermediate D&I expertise list based on their self-assessment of expertise and number of years of D&I experience.
Discussion
The current study documented D&I advice networks across career stages in the US and Canada. Respondents represented individuals with diverse D&I expertise levels, various practice settings, and academic training. Overall, findings demonstrate a somewhat dispersed network that still allows for relatively short paths of connection between most individuals. While the growing nature of the field is a challenge due to the increase in demands for training and mentoring, it is encouraging that most individuals in the network can still connect through a few intermediary connections. Findings highlight opportunities to further connect D&I researchers in the US with those in Canada, individuals with emerging skills in D&I research, and minoritized racial groups, who had fewer advice connections than individuals who reported White race. Training programs and structured pathways for new D&I researchers can help support these individuals and help more individuals progress toward leadership positions.
The network data highlight how information flows between countries and from individuals who are more established in the field to emerging D&I researchers. The limited overlap in advice networks between the US and Canada is not surprising due to the different funding and career structures between the two countries. Despite these differences, the wealth of knowledge and expertise offered by D&I and knowledge translation (KT)/mobilization researchers in these countries offers growth opportunities. Another example of information flow is between individuals at different career levels. The most dominant individuals in the network are those with advanced or expert-level expertise in D&I research, highlighting the need to enhance connections among early career researchers by establishing supportive structures, such as peer support groups, early career networking events, and mentoring programs. The data also revealed greater dispersion for grant and career advice compared to research advice, indicating grant and career mentorship should be the focus of future capacity building initiatives.
In comparison to Norton et al.’s 2012 D&I advice network survey [19], findings from the current study demonstrate a more dispersed network (average geodesic distance = 5.39 versus 2.60 in Norton et al.) with a higher degree of separation. The current network is also less dense (density = 0.0014 vs. 0.0027) and there is a lower probability that adjacent nodes are connected (clustering coefficient = 0.12 vs. 0.32) compared to Norton et al.’s study [19]. Comparisons between the current study and Norton et al.’s findings should be interpreted considering the differences in sample characteristics and network bounding in these studies. Based on the evolution of the field, different individuals were included in these network surveys. In the current study, there was a much larger number of nodes, or people in the network (978 vs. 421), and ties, or links between nodes (3384 versus 483). This pattern indicates that as the field has grown, there are simultaneously more individuals who are connected and an overall more dispersed network with more separation between individuals. A more dispersed and growing network may necessitate network interventions to activate novel interactions between certain segments of the network [35]. Network interventions can occur both locally, within single academic institutions and/or local communities, and nationally. Internal structures within institutions are vital to foster connections among D&I researchers and may include D&I works in progress and educational sessions. National initiatives can include structured application-based mentoring programs [6, 36], networking at conferences, and D&I special interest groups at professional or disease-specific conferences. Enhancing connections through these approaches is an ideal target for D&I scientists because diffusion of innovation theory is the foundation of network interventions [35, 37].
Six of the same individuals (G. Aarons, A. Baumann, R. Brownson, R. Glasgow, B. Powell, and E. Proctor) were identified as most influential within US D&I advice networks in Norton et al.’s work and the current study. These six individuals have been involved as faculty members in large implementation research training programs (e.g., Implementation Research Institute [38], Training Institute for Dissemination and Implementation Research in Health [5], Mentored Training for Dissemination and Implementation Research in Cancer [36]) over many years, so it is not surprising they continue to provide advice to a large number of scientists. All other top advice givers are newly identified in this study, including 12 on the US list, all individuals in Canada, and all identified with beginner or intermediate D&I expertise. In the broad, cross-cutting and interdisciplinary field of D&I research, identifying key sources of information is valuable for individuals new to the field [19, 39, 40]. Furthermore, including individuals in the earlier phases of their careers in this work is essential as we consider the capacity for growth in the field. As the field of D&I continues to grow globally, replicating these methods in other countries may be beneficial. Given the limited connection between D&I advice networks in the US and Canada, we expect there may be even less connection between countries across the globe. Future global advice network studies should focus on countries that have established D&I collaborations between Universities and/or health systems (e.g. HIGH-IRI) [41]. This work can build towards future network interventions to expand the exchange of D&I advice to advance the field and enhance health globally.
To support growth in the field and to combat the limited availability of mentors and funding for training programs [1, 9, 39], the D&I field needs to prepare individuals of various experience levels better to provide advice and mentorship across career stages. More experienced mentors should consider the types of advice earlier career trainees are seeking when framing their advice. While trust and content area knowledge were the most common reasons people cited for seeking advice from an individual across career stages, early career researchers were more likely to seek advice based on their desire to pursue a similar career path to the individual. Experts can consider providing broader career advice to early career trainees in addition to more specific scientific advice. Expanding peer-to-peer mentoring initiatives can contribute to the growth of D&I advice networks and support early career researchers [10]. These initiatives have the potential to reduce disparities in mentoring opportunities and foster future scientific collaborations [10], which is essential given that individuals reporting Asian, Black/African-American/African-Canadian, and other races had far fewer connections than individuals reporting White race. While peer mentoring offers promising opportunities to expand D&I advice networks and the capacity of the field to support early career researchers, these forms of mentorship should complement, not replace, mentoring relationships with more senior researchers [10]. Training programs should consider strategies to pair trainees and faculty members based on the trainee’s preferences and needs.
One barrier to establishing peer mentoring groups as a new primary avenue for D&I advice is the desire of individuals to get advice from people who are considered experts in the field as well as the need for and benefits of sponsorship from more senior mentors. To seek advice effectively, individuals should consider their desired outcome and opportunities to consult a broader network. Researchers can consider documenting their mentoring team using a tool such as The National Center for Faculty Development and Diversity’s Mentor Map [42] to strategize opportunities to learn from a broad group of mentors. Individuals earlier in their D&I research careers often aim to become familiar with new content areas, which may not require consulting field-leading experts. Instead, they can seek out publicly available resources (e.g., podcasts, webinars) [43] or individuals with applicable experience, such as somebody who used a relevant framework in a recent grant proposal or somebody who is familiar with online resources on specific topics. While this approach can help expand the D&I advice network, it can be challenging to identify individuals with specific skills when they are not considered experts in the field. Researchers should consider creatively highlighting their skills through social media (e.g., to demonstrate recent use of specific D&I frameworks or methods), institutional profiles, or volunteering to present on D&I topics at their home institution or other organizations. In addition to highlighting their skills, these avenues can be used to seek advice on certain D&I topics. Academic institutions and funders should support these initiatives, as they contribute to expanding D&I networks and developing successful researchers. Documenting D&I skills helps establish individuals as accomplished researchers and enhances their impact within the D&I advice network.
These findings should be interpreted within the context of the study’s limitations. Our team, including individuals with in-depth knowledge of the field, went through a rigorous process to define and identify the study sample. However, our sampling methods were limited to publicly available information, and it is likely that some individuals engaged in D&I research were not invited to participate. Identifying all individuals engaged in a large and rapidly evolving field such as D&I is challenging. A strength is that participants were able to add the names of individuals we may have missed, and these data were included in the analysis. While our 32% response rate is sufficient for survey studies and is similar to the 31% response rate in Norton et al. [19], a higher response rate benefits network surveys [44]. The response rate resulted in a large amount of missing data in the study from non-respondents, which limited our ability to interpret the findings. Last, we did not ask participants about the frequency with which they sought advice and responses were limited to 10 individuals from whom they sought or gave advice. Collecting additional information may have further contextualized our results, but these choices were made to not over-burden participants.
Conclusions
As the D&I research field expands, it has also led to a more dispersed network. While the network is somewhat less connected than 10 years ago, most individuals can still connect to the main network through a few key individuals. Advanced and expert D&I researchers continue to hold the most prominent positions in the D&I advice network, but there are concerns about meeting the needs of the changing demographics of the field and limited capacity and funding for mentorship. Moving forward, it is crucial to expand opportunities for peer networking and mentoring, especially for minoritized racial groups, to strengthen the field’s capacity.
Data availability
The dataset supporting the conclusion of this article is not made publicly available due to the identifying nature of the data.
Abbreviations
- D&I:
-
Dissemination and implementation
- KT:
-
Knowledge translation
- SNA:
-
Social network analysis
- US:
-
United States
References
Davis R, D’Lima D. Building capacity in dissemination and implementation science: a systematic review of the academic literature on teaching and training initiatives. Implement Sci. 2020;15:97. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13012-020-01051-6.
Straus SE, et al. Education and training for implementation science: our interest in manuscripts describing education and training materials. Implement Sci. 2015;10:136. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13012-015-0326-x.
Huebschmann AG, et al. Promoting rigor and sustainment in implementation science capacity building programs: A multi-method study. Implement Res Pract. 2022;3, https://doiorg.publicaciones.saludcastillayleon.es/10.1177/26334895221146261.
Chambers DA, et al. Mapping training needs for dissemination and implementation research: lessons from a synthesis of existing D&I research training programs. Transl Behav Med. 2017;7(3):593–601.
Meissner HI, et al. The U.S. training institute for dissemination and implementation research in health. Implement Sci. 2013;8(1):12.
Brownson RC, et al. Building the next generation of researchers: mentored training in dissemination and implementation science. Acad Med. 2021;96:86–92. https://doiorg.publicaciones.saludcastillayleon.es/10.1097/acm.0000000000003750.
Guise J-M, et al. Team mentoring for interdisciplinary team science: lessons From K12 scholars and directors. Acad Med. 2017;92:214–21. https://doiorg.publicaciones.saludcastillayleon.es/10.1097/acm.0000000000001330.
Gagliardi AR, Webster F, Straus SE. Straus Designing a knowledge translation mentorship program to support the implementation of evidence-based innovations. BMC Health Serv Res. 2015;15:198. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12913-015-0863-7.
Brownson RC, et al. Closing the gap: advancing implementation science through training and capacity building. Implement Sci. 2024;19:46. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13012-024-01371-x.
Dickson KS, et al. Value of peer mentoring for early career professional, research, and personal development: a case study of implementation scientists. J Clin Transl Sci. 2021;5(1):e112.
Stamatakis KA, et al. Developing the next generation of dissemination and implementation researchers: insights from initial trainees. Implement Sci. 2013;8:29. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/1748-5908-8-29.
Boulware LE, et al. Diversity, equity and inclusion actions from the NCATS Clinical and Translational Science awarded programs. Nat Med. 2022;28(9):1730–1.
Jacob RR, et al. The “secret sauce” for a mentored training program: qualitative perspectives of trainees in implementation research for cancer control. BMC Med Educ. 2020;20:237. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12909-020-02153-x.
Luke DA, et al. Forging a link between mentoring and collaboration: a new training model for implementation science. Implement Sci. 2016;11:137. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13012-016-0499-y.
Hayat T, Mo GY. Mo Advice Giving and Receiving Within a Research Network. Am Behav Sci. 2015;59:582–98. https://doiorg.publicaciones.saludcastillayleon.es/10.1177/0002764214556802.
Akbari-Kamrani M, et al. Social Dynamics of Advice-Seeking: A Network Analysis of Two Residency Programs. Teach Learn Med. 2024;36:23–32. https://doiorg.publicaciones.saludcastillayleon.es/10.1080/10401334.2023.2168671.
Sabot K, et al. Use of social network analysis methods to study professional advice and performance among healthcare providers: a systematic review. Syst Rev. 2017;6:208. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13643-017-0597-1.
Kantek F, et al. Social network analysis: Understanding nurses’ advice-seeking interactions. Int Nurs Rev. 2023;70(3):322–8.
Norton WE, et al. Mapping the growing discipline of dissemination and implementation science in health. Scientometrics. 2017;112:1367–90. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s11192-017-2455-2.
Isba R, Woolf K, Hanneman R. Social network analysis in medical education. Med Educ. 2017;51(1):81–8.
Department of Health and Human Services. Dissemination and Implementation Research in Health (R01 Clinical Trial Optional). 2024 [cited 2024 November 8]; Available from: https://grants.nih.gov/grants/guide/pa-files/PAR-22-105.html.
Canadian Institutes of Health Research. Guide to Knowledge Translation Planning at CIHR: Integrated and End-of-Grant Approaches. 2024; Available from: https://cihr-irsc.gc.ca/e/45321.html#. Cited 2024 November 8,
Luke DA, et al. Introducing SoNHR–reporting guidelines for social networks in health research. PLoS ONE. 2023;18:e0285236.
National Institutes of Health. Science of Implementation in Health and Healthcare – SIHH. 2024 August 26, 2024; Available from: https://public.csr.nih.gov/StudySections/DABP/HSS/SIHH. Cited 2024 September 2
Marin A, Wellman B. Social network analysis: An introduction. The SAGE handbook of social network analysis. 2011:11–25.
R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. 2016 [cited 2023 October 1]; Available from: http://www.R-project.org/.
Newman ME. Assortative mixing in networks. Phys Rev Lett. 2002;89(20):208701.
McNulty, K. Handbook of graphs and networks in people analytics: With examples in R and Python. 2024; Available from: https://ona-book.org/index.html.
Wickham H, et al. Welcome to the Tidyverse. J Open Source Softw. 2019;4(43):1686.
Heinzen, E., et al. _arsenal: An Arsenal of 'R' Functions for Large-Scale Statistical Summaries_. 2021; Available from: https://CRAN.R-project.org/package=arsenal. Cited 2023 October 1
Csardi, G. and T. Nepusz. The igraph software package for complext network research. 2006 [cited 2023 October 1]; Available from: https://igraph.org.
Farine, D. assortnet: Calculate the Assortativity Coefficient of Weighted and Binary Networks. 2023; Available from: https://CRAN.R-project.org/package=assortnet.
United States Census Bureau. U.S. and World Population Clock. 2024 [Cited 2024 September 2]; Available from: https://www.census.gov/popclock/.
Statistics Canada. Canada’s population clock (real-time model). 2024 June 19, 2024 [cited 2024 September 2]; Available from: https://www150.statcan.gc.ca/n1/pub/71-607-x/71-607-x2018005-eng.htm.
Valente TW. Network interventions. Science. 2012;337(6090):49–53.
Padek M, et al. Training scholars in dissemination and implementation research for cancer prevention and control: a mentored approach. Implement Sci. 2018;13:18. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13012-018-0711-3.
Rogers EM, Singhal A, Quinlan MM. Diffusion of innovations. In: An integrated approach to communication theory and research. Routledge; 2014. p. 432–48.
Proctor EK, et al. The implementation research institute: training mental health implementation researchers in the United States. Implement Sci. 2013;8:1–12.
Proctor EK, Chambers DA. Training in dissemination and implementation research: a field-wide perspective. Transl Behav Med. 2016;7:624–35. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s13142-016-0406-8.
Schackman BR. Implementation science for the prevention and treatment of HIV/AIDS. J Acquir Immune Defic Syndr. 2010;55(Suppl 1):S27-31. https://doiorg.publicaciones.saludcastillayleon.es/10.1097/QAI.0b013e3181f9c1da.
Washington University in St. Louis. HIV, Infectious Disease and Global Health Implementation Research Institute (HIGH IRI). 2024 [cited 2024 November 12]; Available from: https://sites.wustl.edu/highiri/.
The National Center for Faculty Development & Diversity. The NCFDD Mentor Map. 2024 [cited 2024 September 2]; Available from: https://www.ncfdd.org/ncfddmentormap.
Darnell D, et al. A content analysis of dissemination and implementation science resource initiatives: what types of resources do they offer to advance the field? Implement Sci. 2017;12:137. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13012-017-0673-x.
Wasserman S, Faust K, Social network analysis: Methods and applications. New York. NY: Cambridge University Press; 1999.
Acknowledgements
Not applicable.
Funding
This research was funded in part by the National Cancer Institute (P50CA244431), the Centers for Disease Control and Prevention (U48DP006395), and the Foundation for Barnes-Jewish Hospital. The findings and conclusions in this paper are those of the authors and do not necessarily represent the official positions of the National Institutes of Health or Centers for Disease Control and Prevention.
Author information
Authors and Affiliations
Contributions
All authors (AL, RJ, SM-R, RG, SS, WN, RG) were involved in the conceptualization of this work, provided feedback on study materials and manuscript drafts, and read and approved the final manuscript. AL identified the study sample based on the team-defined methods and drafted the initial manuscript. RJ completed data management, cleaning, and analysis, created the manuscript visualizations, and drafted portions of the methods section of the manuscript. RB provided oversight and mentorship throughout the research process.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The Institutional Review Board at Washington University in St. Louis approved this study as exempt research.
Consent for publication
All individuals named in Table 7 of the manuscript provided written consent via email to have their name included in the publication.
Competing interests
Wynne Norton and Sharon Straus are on the Editorial Board for Implementation Science. All other authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work was primarily conducted while the first/corresponding author was affiliated with Washington University in St. Louis.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
About this article
Cite this article
L’Hotta, A.J., Jacob, R.R., Mazzucca-Ragan, S. et al. Building capacity in dissemination and implementation research: the presence and impact of advice networks. Implementation Sci 19, 78 (2024). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13012-024-01408-1
Received:
Accepted:
Published:
DOI: https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13012-024-01408-1