On Wednesday, March 6th, the SecondMuse team brought together startups from its two NYC-based manufacturing programs – Futureworks Incubator and M-Corps – for another session in the M-Corps workshop series. Hosted by M-Corps partner New Lab in the Brooklyn Navy Yard, this workshop focused on Quality Assurance (QA).
Founders and teams in attendance heard from a panel of three industry experts– Bob Kowalski, Senior Director of Mechanical Engineering at Intelligent Product Solutions, a cross functional design services and manufacturing company; Diana Pincus, VP of Operations at LittleBits, an award-winning modular electronics platform; and Jim Griszbacher, former VP of Engineering at Teralytics– as well as guest speaker Suma Reddy, COO and Co-Founder of M-Corp’s cohort company Farmshelf. Suma’s experience building and scaling their indoor farming platform for high-end restaurants and hotels served as the perfect case study for lessons learned (so far) about QA management.
M-Corps, funded by NYSERDA and sponsored by Dragon Innovation, launched in September 2018 to help cleantech startups get to market faster through easing the pain of manufacturing. We’re currently supporting a cohort of 11 companies that range from kits that make commercial-grade vehicles electric to consumer solar products, smart ice-melt control systems to naturally occurring soil remediation products. The M-Corps workshop series is based on common needs from startups in SecondMuse programs, and each workshop is open to founders across the manufacturing hardware ecosystem.
Check out posts about our prior workshops – Supply Chain Strategy & Manufacturing 101: Talking to Manufacturers. View the presentation from our QA workshop and explore key takeaways from the session below.
Quality Assurance doesn’t end when a product leaves the assembly line; it matters throughout the entire life of a product. Everything starts with a great Quality Assurance plan. While teams shouldn’t expect to catch every issue from the start, they do need a flexible process in place that they can adapt to quality issues and quickly incorporate more tests to minimize those issues going forward.
Diana Pincus from LittleBits recommends thinking through how your customers will use your product to find failure points. Run mock exercises to simulate how the end user will use (and abuse) your product. For example, when Diana worked at Makerbot, they ran new printers for thousands of hours to test them and identify any issues that might arise from sustained use. When not running test prints, the team would simulate other real-life use cases and failure points, such as performing drop tests to see how the printers held up after falling off a table.
Here’s an example of a test plan for a new hardware product (also known as an Engineering Validation Test (EVT) or Design Validation Test (DVT):
All three facilitators stressed the importance of starting testing early, not only to catch errors, but to avoid scrap. Scrap will inevitably accumulate as a product is tested and refined, but minimizing how much your process produces can reduce the complexity of your operations, the waste you produce, and your cost of production.
When it comes to working with contract manufacturers (CMs), don’t hesitate to give them a QA plan if you already have one. CMs often have the capability to implement a QA process more cost effectively than a startup can on their own. Ultimately, your CM wants you to succeed, because they only get paid if you receive your product(s). Don’t be afraid to ask your CM to share their QA plan!
To implement an airtight QA process, consider using the following tools:
Bring in outside reviewers to review your product frequently. Seek out expert feedback on your design for manufacturing and design for assembly.
Failure Mode and Effects Analysis (FMEA)
Test and analyze your product’s failure points. This is where those drop tests Diana Pincus performed at Makerbot come in. On April 3, we are hosting a Risk Management & Assembly Workshop on this very topic.
Statistical Tolerance Analysis
Make drawings with tolerances linked to functional requirements and run statistical models to ensure fit. This will save you a lot of headaches in the future when you try to fit everything together. If you’re now sure what tolerances your product can or should handle, research similar products on the market and see what they can withstand.
First Article of Inspection
Check every dimension to confirm what is to spec. Be practical about this; if it is something that is going to affect functionality or delay production, you may want to leave it out.
Engineering Validation Test
If you have a set of requirements, make sure everything passes. Run drop tests, test how your product holds up under variable weights, etc. Note that not all tests are physical!
Reliability Testing (Design Validation Testing)
Validate how long your product will last under real-life conditions. Try to find the weak links; this will help you prioritize what to fix in your design.
Clearly define requirements physically and cosmetically and track your testing, the results, and changes made to the design or components. This will help keep your BOM current.
Value Stream Map
Map out where everything comes from. You’ll have a clearer view of the different potential risks, the time involved, or other key pieces and people that are required.
Testing Stations and Checkpoints
Work with your manufacturer to set up testing points along your production line. Your CM can provide guidance for some of these (ie: FMEA, reliability and engineering validation testing), but as an entrepreneur or engineer at a young startup, manage design reviews, first article of inspection, and documentation of your process to ensure you and your team are intimately familiar with problems that need to be addressed and the process by which they will be.
The Root of It All
One important point to remember: when it comes to CMs and quality assurance, you have to ask for it, otherwise they may not plan for it. This may be a challenge for startups with low production volumes that may not have a lot of leverage or cash to make requests with. In these cases, it’s really about building your relationship with your CM and helping them see your potential so they get excited about your product. Treat this stage of your process as a collaboration with your CM; you’re building this product and solving QA issues together. Don’t blame them for problems, but be firm about getting ahead of them when they occur.
Lastly, build your quality assurance strategy around your customer, not your product, because you always have to balance quality and revenue. Your customers, and how they use the product, should be top of mind as you strategize what problems to tackle first. Don’t worry as much about the edge cases.
Case Study: Suma Reddy from Farmshelf
Farmshelf’s product has a lot of parts and subassemblies, some of which may be exposed to light, water, and soil. Sheet metal, glass, and injection molded parts are used to house cameras, LEDs, custom PCBAs; and LED boards make up the brains and interior of the product. That’s a lot of complexity and potential failure points. To know their manufacturing and assembly process inside and out, the team chose to build 100 units in-house, meaning it is essential for them to develop their own QA/QC processes.
Found this post useful? Come to our upcoming workshops!
In January, SecondMuse continued its newest series of hardware startup support. This session focused on Supply Chain Strategy at New Lab in Brooklyn Navy Yard. NYCEDC’s Stacey Weismiller and Inventaprint’s Rich Mokuolu lead attendees through an essential presentation on sourcing and production.
In January, M-Corps launched the first manufacturing workshop in a series that will stretch into 2020. At Urban Future Lab, we kicked off with Manufacturing 101: Talking to Manufacturers, a panel discussion with local experts and moderated by SecondMuse Senior Director Katey Metzroth.
On Day 3 of onboarding, at Pratt Institute’s BF+DA, we dug into the manufacturing tools available to help startups level up from prototype to production. These included a Manufacturing Readiness Level (MRL) assessment and SecondMuse’s Production Scale Up Roadmap (PSR).