Home Resource Know What AI Tools Can and Can’t Do: Discernment as a Project Manager Skill

Know What AI Tools Can and Can’t Do: Discernment as a Project Manager Skill

By Raymundo Tamayo

Why this matters now

AI tools are everywhere, but impact isn’t automatic. Recent evidence shows that while adoption is high, meaningful value depends on choosing the right tool for the right job and understanding limitations before integration. McKinsey’s State of AI: Global Survey 2025 highlights growing experimentation with agentic systems, but also the risk of scattered tool use with little outcome alignment.

This underlines a simple truth: discernment beats accumulation.

The challenge: Tool enthusiasm without a clear match to delivery needs

In project teams, it’s common to adopt AI tools based on excitement or convenience. A staff member downloads a summarization app. Another uses an AI assistant for drafting. A third tries an agentic workflow tool. Individually, these choices may save minutes. But improving project delivery (cycle time, quality, stakeholder outcomes) requires a systematic match between capability and task.

This dynamic shows up in nonprofit contexts as well. The Nonprofit AI Collaboration Index 2025 found nearly universal belief that AI “has a place at work,” yet only a minority of professionals use AI as a strategic partner in their core work. Many remain at basic, tactical use. That gap between adoption and strategic impact signals a need for better tool literacy and selection discipline.

A simple taxonomy: What tools are good at, and where they fall short

A useful starting point is to think of AI tools not as a monolith, but as belonging to four practical capability tiers. Each has value when matched to specific delivery tasks.

1. Drafting & Summarizing Tools

Strengths:

  • Create first drafts of text (reports, emails, proposals)
  • Condense long documents into key points

Limits:

  • Can hallucinate (invent facts)
  • Don’t understand meaning the way a human does

When to use:

  • Drafting routine sections
  • Preparing summaries for review

When to avoid:

  • Final deliverables without review
  • Legal, financial, or highly contextual narratives

Common examples

  • Chat-based generative AI tools (e.g., products from OpenAI, Google, Anthropic)
  • Built-in AI drafting features in office suites (e.g., Microsoft productivity tools)

2. Pattern Extraction & Search Tools

Strengths:

  • Extract themes, trends, and key terms from text
  • Resurface information from large repositories

Limits:

  • Limited context awareness
  • Often require structured inputs to excel

When to use:

  • Reviewing project documentation
  • Spotting recurring risk themes in logs

When to avoid:

  • Strategic interpretation without human oversight

Common examples

  • AI-powered research and search tools (e.g., products from Perplexity)
  • Knowledge-base tools with AI search or synthesis features
  • Document analysis platforms used in evaluation and research contexts

3. Basic Automation Tools

Strengths:

  • Repeat rule-based tasks
  • Move data between systems

Limits:

  • Struggle with exceptions and judgment calls

When to use:

  • Standard data entry
  • Triggering notifications

When to avoid:

  • Tasks with frequent variation

Common examples

  • No-code / low-code automation platforms
  • Workflow automation inside project management or CRM tools

4. Workflow/Agentic Systems

Strengths:

  • Coordinate across apps and steps
  • Execute multi-part tasks

Limits:

  • Can be brittle without clear design and governance
  • Require good data hygiene

When to use:

  • Structured processes (e.g., report generation pipelines)
  • Handoff orchestration

When to avoid:

  • Unscoped or ill-defined processes

Common examples

  • Agent-based workflow tools emerging from enterprise AI platforms
  • Custom workflows built using orchestration frameworks on top of existing systems

 

Four questions to apply before you adopt a tool

Before approving or piloting an AI tool in your project workflow, ask:

  1. What outcome am I trying to improve?
    Be specific (e.g., reduce status reporting time by 30% with no loss of quality).
  2. What evidence will tell me this tool is helping?
    Define measures (cycle time, error rate, stakeholder satisfaction).
  3. What risks does this tool introduce?
    Data sensitivity, compliance, transparency, accountability.
  4. Who needs to own this tool’s use and governance?
    Identify a responsible person or team, not just an enthusiastic adopter.

These questions shift the conversation from “Can we use it?” to “Should we use it—and how will we know if it works?”

Two common mistakes project teams make

Mistake 1: Tools without tasks

Teams adopt tools because they are new or recommended, not because they solve a targeted problem. This creates noise, duplication, and little measurable benefit.

Mistake 2: Treating tools as decision makers

Some teams lean on outputs as if they are authoritative. This is risky, especially where nuance, context, or accountability matters. AI outputs should be inputs to human decisions, not replacements.

What to do this week

Try this quick three-step routine:

  1. Inventory your current AI uses
    List where tools are used in your project delivery cycle.
  2. Classify each use against the taxonomy above
    Mark whether it’s drafting, pattern extraction, automation, or workflow.
  3. Score each use on impact + risk
    Use a simple 1–5 scale for both. Prioritize changes for high-impact, low-risk areas.

This simple diagnostic gives you a baseline and a starting point for smarter adoption.

Takeaway

Discernment isn’t about knowing every tool. It’s about understanding the capability you need, matching a tool to that capability, and being honest about limitations. Strong project delivery in 2026 won’t come from piling on tools; it will come from choosing the right tools and governing their use wisely.

Coming up next

In our next resource, we’ll explore how to embed AI into workflows that matter, moving beyond individual prompts to integrated support for planning, execution, reporting, and learning.

References