Softpanorama

May the source be with you, but remember the KISS principle ;-)
Home Switchboard Unix Administration Red Hat TCP/IP Networks Neoliberalism Toxic Managers
(slightly skeptical) Educational society promoting "Back to basics" movement against IT overcomplexity and  bastardization of classic Unix

Softpanorama Bulletin
Vol 25, No.06 (June, 2013)

Prev | Contents | Next

Bulletin 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007
2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018
Jan Feb Mar Apr May Jun Jul Sept Oct Nov Dec

A Note on the Relationship of Brooks Law and Conway Law

By Dr. Nikolai Bezroukov

Version 0.8, June, 2013

Abstract

Brooks law is not about man-month it is about complex relationship between structure of the project and structure of the team of developers involved.  That's why, grossly simplifying, adding manpower to the late project is not trivial task because unless the structure of the team has "free spaces" they can fit. The second factor is that the history of development of a large software project is typically unwritten saga; without knowing the history and agreed compromised and dead ends eliminated, the new developer can easily get into serious troubles and their efforts can be counterproductive and slow down the team. Those two factors can make late project even more late. But there is third factor that often escape attention -- there is a natural limit the number of productive team members in each project, as the areas of responsibility need to carved very carefully according to adopted architecture.  In a sense adding additional developers can distort adopted architecture and that may even doom the project. 

It is simplistic to assume that modularity of a project permits unlimited the number of developers who can be effective and work without stepping on each other toes. Number of developers who are participating in given project is affected by many factors and in turn affects the architecture of the product as each developer try to carve his niche and then enlarge it according to the level of talent and ambition he/she has. In other words, there is a feedback loop from the structure of the developer group to the structure of the software system under development. This is probably the most overlooked side of  Brooks Law.

Introduction

Brooks Law came under scrutiny due to that fact the Eric Raymond claimed that it is not applicable to open source development in his simplistic, but popular at the time article Cathedral and Bazaar. It contradicts "Bazaar" fairy tale which is an essential part of the ideology of "Raymondism" which along with Stallmanism are two most prominent open source ideologies.  It was informally adopted by an influential part of open source movement which preach merging open source development with the commercialization of open source (using modified "slaves on the plantation" model).  And those pseudo-religious overtones polluted the discussion ever since.

But the essence of Brooks law is not so much about the fact that adding manpower to the late project more often then not makes it later. The essence is that it postulates complex relationship between the structure of the project and structure of the team of developers involved.  Only the side effect of  this relationship is exposed in the law: the fact that grossly simplifying, adding manpower to the late project is not trivial task that more often then not makes late project even more late.

It is simplistic to assume that modularity on a project determines the number of developers who can be effective and work without stepping on each other toes. Number of developers who are participating in given project is affected by many factors and in turn affects the architecture of the product as each developer try to carve his niche. In other words, there is a feedback loop from the structure of the developer group to the structure of the software system under development. This is probably the most overlooked side of  Brooks Law:

There is a feedback loop from the structure of the developer group to the structure of the software system under development. This is probably the most overlooked side of  Brooks Law.

It is generally it is modularity determines the optimal number of developers who can productively work on  a given project in parallel. Of course good communication protocols are the also the key: 

"For example if a project logically consists of three parts and we have two developers, than adding third developer can be highly beneficial -- the structure of the project will now correspond to the structure of the team. If the project is decomposable into three major parts and we add fourth developer, the effect will be much less."

But the fact that team of developers exert influence on the structure of software system under development is nothing new and is known as Conway Law.  For those who don't remember Conway law here is the definition from Wikipedia

Although sometimes construed as humorous, Conway's Law was intended as a valid sociological observation. It is based on the reasoning that in order for two separate software modules to interface correctly, the designers and implementers of each module must communicate with each other.

Therefore, the interface structure of a software system will reflect the social structure of the organization that produced it.

The key point of this quote is that Brooks Law and Conway Law are connected and reflect different sides of the same phenomenon. The fact that the excessive number of developers affects the architecture and the integrity of the product was the key topic of Brooks book, which after all is about of his expensive failure as the operating system architect. In this role he was unable to withstand the pressure of  involving large group of the developers in the kernel development project and as a result got weak, poorly architectured OS.  This extremely important lesson of S/360 development is now "lost in translation". 

It actually relationship between Conway Law and Brooks law runs deeper then stated in Brooks's book. Developers are not passive pawn moved by a "grossmeister" architect on the development check board. They are active and have their own ambitions which drive theirs behavior in ways that often looks illogical to the outside observer. The history of large projects is replete with instances of various  skirmishes, some very small and insignificant, some larger and pretty significant,  in which there are defenders and attackers of status quo but implicit fight is always about the control.  Some developers even leave the project as a result of thos conflicts. Generally the more talented the developer is the more ambitious he/she is and the more control of the project he/she wants.  Not the other way around. 

That's why management of software developers is often compared to "herding cats" and adding a talented developer to the project is a more dangerous exercise then adding average developer. In involves taking a part of work and responsibilities from the existing developer and bestowing them on a new member of the team, who generally need time to learn the ropes and at least at he beginning is totally dependent of the "previous host". Done by weak manager who does not possesses an adequate architectural knowledge and can't predict the conflicts that can arise due to interconnections of the parts, such actions often disrupts existing power structure, the pecking order and introduce latent conflict.  

I would say more: adding talented developers beyond the number necessary to control key subsystems can have a crippling effect on the structure of the product as implicitly they will fight for their "breathing space".   I observed this effect myself during big but boring reengineering projects, which supposedly should not excite too much ambitions in the participants as the system already exists, proven and just needs to be rewritten in a different language or for different platform.  But no, passions flare high and attempts to carve extra space from more ambitious and more abrasive part of the team consumed a lot of my time. At one point, I was forced just to remove the developer who was overly "possessive" about particular subsystem as the whole subsystem he was responsible for could be integrated with the another.  You can find similar examples in the history of large open source projects too.

Managers is another wild card and in commercial projects they add to the equation in very unobvious way, often prematurely freezing the architecture  as well as by complicating and withholding vital communication between developers. And that's not because they are evil, they just want their place in the power structure and protect it. If they are not technically astute they represent huge obstacle in any desirable change of the architecture.  In a biting satire Addendum to Brooks’ Law - MindBy noted:

I just read Joel Spolsky’s blog entitled “A Little Less Conversation” which discusses something I’ve blogged about in the past here and here, communication overload.

After reading that post I began to consider my own personal experience in meetings over the last dozen or so years and decided to add an addendum to the communication node problem that was so eloquently detailed in the Mythical Man Month by Brooks.

The problem with Brooks’ theory of intercommunication is that it doesn’t take into account the “Number of Managers” in any given meeting.  He assumes in his calculation that all nodes in a communication network are equal.  This is a mistake.  All nodes are not equal, as anyone who has sat through a meeting with more than one manager participating can attest to.

Managers have keen insight into every major (and minor) issue at hand and willingly share that information with the team in a seemingly endless discourse that greatly adds to the meeting’s productivity and value.  In fact I’ve been in meetings with multiple managers that have lasted two, maybe three, times longer than the scheduled meeting length due to the significant wisdom that each of the managers was imparting to their counterparts and the team.

Critique of Wikipedia "Exceptions"

Let me address some of the points in Wikipedia, which defend  Raymond's critique of Brooks Law by providing plausible "exceptions":

  1. The first point is to note that Brooks' Law often applies to projects that are already late.[4] Projects can be brought back into (or kept in) control if people are added earlier in the process.[5] It is also important to determine if the project is really late, or if the schedule was originally overly optimistic. Scheduling mistakes account for a large number of late projects. Correcting the schedule is the best way to have a meaningful and reliable time frame for the project's completion.[6]

    First of all overoptimistic schedule is the immanent feature of software projects, do it goes without saying. For all my career I never saw a project where schedule was overly conservative :-). Also being late to the market has distinct consequences for any projects, open source included. Few, for example,  now care if, for example Perl 6 is magically delivered to the amazed audience in its full glory. After Ruby with its Rails framework was released, the time for Perl 6 and its potential niche shrunk, solutions proposed in Perl 6 now themselves look questionable and semi-antiquated,  and those developers who theoretically can benefit from it probably already switched to Ruby.

  2. The quantity, quality and role of the people added to the project also must be taken into consideration. One simple way to circumvent the law on an overrun project is to add more people than needed, in such a way that the extra capacity compensates the training and communication overhead.[7] Good programmers or specialists can be added with less overhead for training.[8] People can be added to do other tasks related with the project, for example, quality assurance or documentation; given that the task is clear, ramp up time is minimized.[9]

    Yes, quality of people should be taken into consideration, but effects are not those that are proposed. The key issue is there a free "modular space" or not (or can it be created by moving some less productive developers). If there is no free "modular space", the capability of the developer can serve as a disruptive force, dynamite to the building already on fire, so to speak.  Nobody like to be a pawn in somebody else game, and talented developers are much less included to play this role then the general population.  They will always play their own game and the manager who brought those developers has not much control after the fact, as his own credibility now lingers on the decisions made.

  3. Good management and development practices also help to minimize the impact of Brooks' Law. The modern practices of continuous integration, test first design, and iterative development significantly reduce the inter-developer communication overhead, and thus allow for better scalability. New tools for software development and documentation also help to minimize the ramp up time, making it simpler for new programmers to get involved in the work. Design patterns simplify the distribution of work, because the entire team can do its part within the framework provided by that pattern. The design pattern defines the rules that the programmers follow, simplifies communication through the use of a standard language, and provides consistency and scalability. Finally, good segmentation helps by minimizing the communication overhead between team members. Smaller sub-problems are solved by a smaller team, and a top-level team is responsible for systems integration. For this method to work, the segmentation of the problem must be done correctly in the first place; if done incorrectly, this can make the problem worse, not better, by impeding communication between programmers working on parts of the problem which are actually closely coupled, even when the project plan has decreed that they are not.

    What is called  "Good management and development practices " by some, can be called as stagnation and red tape by others. Those waterfall methodologies like "continuous integration, test first design, and iterative development " Often the key problem of the project is the leading developer lost motivation and left the wheel, allowing even less capable members of the team to draw shots. Resulting loss of architectural integrity can be fatal no matter who and when you add.  If this happens only heavens can save the project as much less capable people will now drive key decisions.

    Also at some point it became clear that the current architectural solution is inadequate and needs to be replaced by a better one. This is a difficult decisions to make and it is make even more difficult  by preaching continuity. Disruptions are not always harmful. Sometime canning the subsystem is the way to go instead of adding the developers. 

  4. Some authors – see, for example, Creating a Software Engineering Culture by Karl E. Wiegers – have stressed the importance of the social and political aspects of the work climate as determinants of the effectiveness of individual programmers and the project team as a whole. Rather than depending on heroes to carry the day with extraordinary efforts,

    There is no place for ordinary people for leading riles in large software projects. If such projects can be delivered with "ordinary" leaders you can bet that other similar projects already exist and can be used instead. So the whole point of development became mute. In large scale, complex projects,  the vision of the key developer/architect is the decisive force. It is much like role of field-marshal on the battlefields. The individual units might be OK, but they will not fight with the same ferocity if they do not see the leader a visionary, and the cause honorable. On the contrary, with talented leader often average teams can deliver amazing results.

Critique of Scott Berkun Observations on Brooks Law

Supplement

Wikipedia text used in the note (accessed March 9, 2011)

Exceptions and possible solutions

Brooks' Law is often cited to justify why projects keep being late, despite management efforts. However, there are some key points in Brooks's Law that allow exceptions and open the door for possible solutions.[2][3]

The first point is to note that Brooks' Law often applies to projects that are already late.[4] Projects can be brought back into (or kept in) control if people are added earlier in the process.[5] It is also important to determine if the project is really late, or if the schedule was originally overly optimistic. Scheduling mistakes account for a large number of late projects. Correcting the schedule is the best way to have a meaningful and reliable time frame for the project's completion.[6]

The quantity, quality and role of the people added to the project also must be taken into consideration. One simple way to circumvent the law on an overrun project is to add more people than needed, in such a way that the extra capacity compensates the training and communication overhead.[7] Good programmers or specialists can be added with less overhead for training.[8] People can be added to do other tasks related with the project, for example, quality assurance or documentation; given that the task is clear, ramp up time is minimized.[9]

Good management and development practices also help to minimize the impact of Brooks' Law. The modern practices of continuous integration, test first design, and iterative development significantly reduce the inter-developer communication overhead, and thus allow for better scalability. New tools for software development and documentation also help to minimize the ramp up time, making it simpler for new programmers to get involved in the work. Design patterns simplify the distribution of work, because the entire team can do its part within the framework provided by that pattern. The design pattern defines the rules that the programmers follow, simplifies communication through the use of a standard language, and provides consistency and scalability. Finally, good segmentation helps by minimizing the communication overhead between team members. Smaller sub-problems are solved by a smaller team, and a top-level team is responsible for systems integration. For this method to work, the segmentation of the problem must be done correctly in the first place; if done incorrectly, this can make the problem worse, not better, by impeding communication between programmers working on parts of the problem which are actually closely coupled, even when the project plan has decreed that they are not.

Some authors – see, for example, Creating a Software Engineering Culture by Karl E. Wiegers – have stressed the importance of the social and political aspects of the work climate as determinants of the effectiveness of individual programmers and the project team as a whole. Rather than depending on heroes to carry the day with extraordinary efforts,

Wiegers argues that a team of ordinarily-skilled individuals can repeatedly deliver timely results in the right work environment. Efforts to improve the effectiveness of teams can ameliorate, if not eliminate, the consequences of Brooks's law.

A recent instance shows the fallacies of relying on Brook's Law in rapidly changing areas like open source software. Destroying the man-month myth

Open source software development

While open source projects rarely have schedules, nonetheless they can reach a state in which they are called "late" by their sponsors, participants, and users. In such a case, Brooks's law ("adding manpower to a late software project makes it later") surely applies, for exactly the reasons that Brooks enumerates:

In addition, unless there are strict controls, newcomers may reduce the productivity of experienced developers by checking in buggy or inappropriate changes, which then have to be backed out.

Read more: http://www.answers.com/topic/brooks-law#ixzz1G9FtA81Y

•a b Frederick P. Brooks, Jr. "The Mythical Man Month". 1995. Addison-Wesley.
•^ "In spite of Brooks’ Law, adding people to a late project remains commonplace" ... "I have evangelized this well-worn software engineering chestnut many times myself, but I no longer think it’s true". (McConnell, 1999)
•^ "The trouble is that there are important exceptions that many people do not take the time to consider when using Brooks’ law to justify something". (Berkun, 2006)
•^ "Implicit in those projects is that it applies only to the final phases of a project. The question is, How do you know whether you’re in a project’s final phases?" (McConnell, 1999)
•^ "We have found that adding people to a late project will always increase its cost, but the project may not always be late since there may be sufficient schedule to absorb them and the project may not be at maximum staffing. Only under certain degree of sequential constraints among project tasks will the project be delayed." (Hsia, Hsu, Kung, 1999)
•^ Late chaotic projects are likely to be much later than the project manager thinks--project completion isn’t three weeks away, it’s six months away. Go ahead and add staff. You’ll have time for them to become productive. Your project will still be later than your plan, but that’s not a result of Brooks’ Law. It’s a result of underestimating the project in the first place." (McConnell, 1999)
•^ "Gordon and Lamb studied Brookss Law and suggested that the best way to recover from a slipping schedule is to add more people than might be expected to be necessary, and to add them early." (Hsia, Hsu, Kung, 1999)
•^ "The law assumes that all added manpower is equal, which is not true. Given the choice of adding a good programmer, who knows the code base and is friends with half the team, I’d consider it." (Berkun, 2006)
•^ "The sad but popular approach is to throw people in without much explanation and let everyone figure it out for themselves. But if the manager clarifies why Sally and Rupert are joining, and defines good roles for them, with input from the team, they’ll be set up to make a smooth transition." (Berkun, 2006)



Etc

Society

Groupthink : Two Party System as Polyarchy : Corruption of Regulators : Bureaucracies : Understanding Micromanagers and Control Freaks : Toxic Managers :   Harvard Mafia : Diplomatic Communication : Surviving a Bad Performance Review : Insufficient Retirement Funds as Immanent Problem of Neoliberal Regime : PseudoScience : Who Rules America : Neoliberalism  : The Iron Law of Oligarchy : Libertarian Philosophy

Quotes

War and Peace : Skeptical Finance : John Kenneth Galbraith :Talleyrand : Oscar Wilde : Otto Von Bismarck : Keynes : George Carlin : Skeptics : Propaganda  : SE quotes : Language Design and Programming Quotes : Random IT-related quotesSomerset Maugham : Marcus Aurelius : Kurt Vonnegut : Eric Hoffer : Winston Churchill : Napoleon Bonaparte : Ambrose BierceBernard Shaw : Mark Twain Quotes

Bulletin:

Vol 25, No.12 (December, 2013) Rational Fools vs. Efficient Crooks The efficient markets hypothesis : Political Skeptic Bulletin, 2013 : Unemployment Bulletin, 2010 :  Vol 23, No.10 (October, 2011) An observation about corporate security departments : Slightly Skeptical Euromaydan Chronicles, June 2014 : Greenspan legacy bulletin, 2008 : Vol 25, No.10 (October, 2013) Cryptolocker Trojan (Win32/Crilock.A) : Vol 25, No.08 (August, 2013) Cloud providers as intelligence collection hubs : Financial Humor Bulletin, 2010 : Inequality Bulletin, 2009 : Financial Humor Bulletin, 2008 : Copyleft Problems Bulletin, 2004 : Financial Humor Bulletin, 2011 : Energy Bulletin, 2010 : Malware Protection Bulletin, 2010 : Vol 26, No.1 (January, 2013) Object-Oriented Cult : Political Skeptic Bulletin, 2011 : Vol 23, No.11 (November, 2011) Softpanorama classification of sysadmin horror stories : Vol 25, No.05 (May, 2013) Corporate bullshit as a communication method  : Vol 25, No.06 (June, 2013) A Note on the Relationship of Brooks Law and Conway Law

History:

Fifty glorious years (1950-2000): the triumph of the US computer engineering : Donald Knuth : TAoCP and its Influence of Computer Science : Richard Stallman : Linus Torvalds  : Larry Wall  : John K. Ousterhout : CTSS : Multix OS Unix History : Unix shell history : VI editor : History of pipes concept : Solaris : MS DOSProgramming Languages History : PL/1 : Simula 67 : C : History of GCC developmentScripting Languages : Perl history   : OS History : Mail : DNS : SSH : CPU Instruction Sets : SPARC systems 1987-2006 : Norton Commander : Norton Utilities : Norton Ghost : Frontpage history : Malware Defense History : GNU Screen : OSS early history

Classic books:

The Peter Principle : Parkinson Law : 1984 : The Mythical Man-MonthHow to Solve It by George Polya : The Art of Computer Programming : The Elements of Programming Style : The Unix Hater’s Handbook : The Jargon file : The True Believer : Programming Pearls : The Good Soldier Svejk : The Power Elite

Most popular humor pages:

Manifest of the Softpanorama IT Slacker Society : Ten Commandments of the IT Slackers Society : Computer Humor Collection : BSD Logo Story : The Cuckoo's Egg : IT Slang : C++ Humor : ARE YOU A BBS ADDICT? : The Perl Purity Test : Object oriented programmers of all nations : Financial Humor : Financial Humor Bulletin, 2008 : Financial Humor Bulletin, 2010 : The Most Comprehensive Collection of Editor-related Humor : Programming Language Humor : Goldman Sachs related humor : Greenspan humor : C Humor : Scripting Humor : Real Programmers Humor : Web Humor : GPL-related Humor : OFM Humor : Politically Incorrect Humor : IDS Humor : "Linux Sucks" Humor : Russian Musical Humor : Best Russian Programmer Humor : Microsoft plans to buy Catholic Church : Richard Stallman Related Humor : Admin Humor : Perl-related Humor : Linus Torvalds Related humor : PseudoScience Related Humor : Networking Humor : Shell Humor : Financial Humor Bulletin, 2011 : Financial Humor Bulletin, 2012 : Financial Humor Bulletin, 2013 : Java Humor : Software Engineering Humor : Sun Solaris Related Humor : Education Humor : IBM Humor : Assembler-related Humor : VIM Humor : Computer Viruses Humor : Bright tomorrow is rescheduled to a day after tomorrow : Classic Computer Humor

The Last but not Least Technology is dominated by two types of people: those who understand what they do not manage and those who manage what they do not understand ~Archibald Putt. Ph.D


Copyright © 1996-2021 by Softpanorama Society. www.softpanorama.org was initially created as a service to the (now defunct) UN Sustainable Development Networking Programme (SDNP) without any remuneration. This document is an industrial compilation designed and created exclusively for educational use and is distributed under the Softpanorama Content License. Original materials copyright belong to respective owners. Quotes are made for educational purposes only in compliance with the fair use doctrine.

FAIR USE NOTICE This site contains copyrighted material the use of which has not always been specifically authorized by the copyright owner. We are making such material available to advance understanding of computer science, IT technology, economic, scientific, and social issues. We believe this constitutes a 'fair use' of any such copyrighted material as provided by section 107 of the US Copyright Law according to which such material can be distributed without profit exclusively for research and educational purposes.

This is a Spartan WHYFF (We Help You For Free) site written by people for whom English is not a native language. Grammar and spelling errors should be expected. The site contain some broken links as it develops like a living tree...

You can use PayPal to to buy a cup of coffee for authors of this site

Disclaimer:

The statements, views and opinions presented on this web page are those of the author (or referenced source) and are not endorsed by, nor do they necessarily reflect, the opinions of the Softpanorama society. We do not warrant the correctness of the information provided or its fitness for any purpose. The site uses AdSense so you need to be aware of Google privacy policy. You you do not want to be tracked by Google please disable Javascript for this site. This site is perfectly usable without Javascript.

Last modified: March 12, 2019