• Solutions
    Back

    BY USE CASE

    Overview Accelerate your NPI Programs Improve Quality and Yield Increase Margins Data and AI Transformation

    BY ROLE

    Engineering Leadership Manufacturing Operations Leadership Quality Leadership Test Engineering

    BY ELECTRONICS INDUSTRY

    All Industries Consumer Industrial and Communications Aerospace and Defense

  • Product
    Back

    Product

    Features How it works Implementation Emergency Services

  • Customers
    Back

    Customers

    Case Studies Customer Testimonials

  • Learn
    Back

    BUILD BETTER HANDBOOK

    Introduction Getting Culture Right NPI: A How To Guide Production: A Primer for Operations Quality Thinking Ahead: How to Evaluate New Technologies

    ADDITIONAL RESOURCES

    Blog Case Studies Webinars & Videos Whitepapers Teardowns

  • Company
    Back

    CAREERS

    Job Postings Meet the Team Life at Instrumental Engineering at Instrumental Team Blog

    ABOUT INSTRUMENTAL

    About Us Company News Contact Us

  • Log in SPEAK TO AN EXPERT
  • Search
Log in SPEAK TO AN EXPERT

News, Blog, & Resources

Case Studies

All Site

list
Build Better Handbook: Table of Contents
  •   

    Start Here

    • Introduction to the Build Better Handbook

    • Manufacturing Term Glossary

  •   

    Getting Culture Right

    • Jeff Lutz: Team Culture Drives Product Performance

    • Scrappy Ways to Execute Like Apple

    • Building a Culture of Quality

      • Building the World's Most Reliable Products: Insights from Medical and Defense Leaders
      • Fear Management
  •   

    NPI: A How To Guide for Engineers & Their Leaders

    • Leading from the Front

      • Building the Team
      • Quality is Set in Development & Maintained in Production
      • 3 Lessons from Tesla’s Former NPI Leader
      • Reject Fake NPI Schedules to Ship on Time
      • Leadership Guidance for Failure to Meet Exit Criteria
    • Screws & Glue: Getting Stuff Done

      • Choosing the best CAD software for product design
      • Screws vs Glues in Design, Assembly, & Repair
      • Best Practices for Glue in Electronics
      • A Practical Guide to Magnets
      • Inspection 101: Measurements
      • A Primer on Color Matching
      • OK2Fly Checklists
      • Developing Your Reliability Test Suite
      • Guide to DOEs (Design of Experiments)
      • Ten Chinese phrases for your next build
    • NPI Processes & Workflows

      • EVT, DVT, PVT Stage Gate Definitions
      • Hardware Schedules are Driven by Iteration
      • The Shedletsky Test: 12 Requirements for NPI Programs
  •   

    Production: A Primer for Operations, Quality, & Their Leaders

    • Leading for Scale

      • Greg Reichow’s Manufacturing Process Performance Quadrants
      • 8D Problem Solving: Sam Bowen Describes the Power of Stopping
      • Oracle Supply Chain Leader Mitigates Risk with Better Relationships
      • Brendan Green on Working with Manufacturers
    • Ship It!

      • Serialization for Electronics Manufacturing
      • Tactics to Derisk Ramp
      • E-Commerce Ratings Make Product Quality a Competitive Edge
    • Production Processes & Workflows

  •   

    Thinking Ahead: How to Evaluate New Technologies

    • Saw through the Buzzwords

      • Automation Tipping Points
      • CTO of ASUS: Systems Integrators for Manufacturing Automation Don't Scale
    • Opportunity Analysis and Realizing Value

    • Building a Buying Committee

    • How to Buy Software (for Those Who Don't Usually)

  1. Build Better Handbook
  2. NPI: A How To Guide for Engineers & Their Leaders
  3. The Shedletsky Test: 12 Requirements for NPI Programs

The Shedletsky Test: 12 Requirements for NPI Programs

Estimated reading time: · link copy link

What are the requirements for an excellent new product introduction (NPI) process?

In 2000, Joel Spolsky published a self-described "sloppy" list of the twelve things to rate the quality of a software team. I first encountered it while posting software job listings, where I was asked to report my "Joel Score" so that candidates would know what kind of software team we are (we give ourselves a 10, by the way).

As a mechanical engineer who co-founded a software company, I often wonder what hardware can learn from software and vice versa. I've taken inspiration from The Joel Test to posit my own "sloppy" criteria for rating the quality of a hardware development process based on my experiences working closely with many hardware companies across multiple manufacturing verticals.

The Shedletsky Test is company-size agnostic. Most items are more about process and rigor and don't directly cost money to implement, just expertise.

The Shedletsky Test

Twelve yes or no questions. Your process gets one point for each question where the answer is yes.

Here's the test:

  1. Does your team formally review designs and drawings before tool release? A formal process may include a checklist, multiple people spinning CAD, and redlining drawings.
  2. Are you confident that each critical stack or fit in your product has a tolerance analysis? Add one bonus point if they all live in a centralized location where each team member can access them.
  3. Do your builds have explicit entry and exit criteria — and if a build does not meet exit criteria, do you repeat it? Minus one point if you have ever done an XVT.
  4. Do you send product design engineers and operations team members to each build? If you are leveraging a JDM model, replace the product design engineer with the system engineer -- the person who owns the design on the brand side. If you build locally, do team members spend significant time on the floor watching and learning from the process?
  5. Do you individually serialize all units and track data by serial number?
  6. Quality process, based on production volume:
    1. For high-volume: Do you destructively test 25-50% of your units at each build?
    2. For low-volume: Do you have a documented strategy and operational plan to achieve Zero Defect or other contractually-obligated quality requirements?
  7. Do you complete and review failure analysis on each unit that fails?
  8. Do you measure and review all critical-to-function and critical-to-quality dimensions at each build and calculate Cpk?
  9. Do you have a main issues list (MIL) process? This includes tracking issues, assigning specific individuals to close them out, and regularly following up on the progress.
  10. Do engineers have easy and immediate access to build data without asking the factory?
  11. Do you invest in your factory team? This includes rapport building, training, and dedicated time to level each other up based on the expertise that each brings to the table.
  12. Do you invest in backup designs (Plan B, C, etc) and engineering tools for your team?

The Scores

If you totaled more than 10, your hardware development process is a tight ship and likely benefits from fewer development fire drills, higher quality builds, and a higher likelihood of on-time product releases.

If you totaled 10, you're in good company. We have worked with several well-known Fortune 500 companies and admired startups at or "almost" at 10 points. A 10-point process still has holes through which issues can slip and fester, but this level of rigor in the hardware development process is serviceable.

If you totaled nine or below, your hardware development process has serious holes which could have consequences. While it's possible to "get lucky" and not have serious issues as you move from development to production with a less-than-10-point process, our experience suggests companies with processes like these tend to struggle to release high-quality products on time.

Views: 161
  • Log In
  • Speak to an Expert

Subscribe to the Build Better newsletter for tips on improving your builds.

Subscription successful!
Please fill out your email!

© 2023 Instrumental. Privacy Policy

  • Twitter_Logo_Blue