The Artima Developer Community
Sponsored Link

Weblogs Forum
Why? Language Archaeology ... and Metaprogramming

89 replies on 6 pages. Most recent reply: Sep 14, 2009 4:31 PM by Andy Dent

Welcome Guest
  Sign In

Go back to the topic listing  Back to Topic List Click to reply to this topic  Reply to this Topic Click to search messages in this forum  Search Forum Click for a threaded view of the topic  Threaded View   
Previous Topic   Next Topic
Flat View: This topic has 89 replies on 6 pages [ 1 2 3 4 5 6 | » ]
Bruce Eckel

Posts: 875
Nickname: beckel
Registered: Jun, 2003

Why? Language Archaeology ... and Metaprogramming (View in Weblogs)
Posted: Jun 16, 2009 1:03 PM
Reply to this message Reply
Summary
I showed up at the organizational meeting for the ANSI/ISO C++ standards committee because Bjarne Stroustrup asked me to. I knew him from my early C++ work and from conferences, and I suspect he considered me a friendly influence.
Advertisement

I had no intention of committing to the time, money and travel necessary to meet three times a year, for a week each time, but the organizational meeting was in Washington DC and I was living in Pennsylvania at the time so I thought "what the heck, I'll drive a few hours and check it out."

Note: My keynote at the upcoming EuroPython conference, June 30-July 2 in Birmingham, UK will be on language archaeology. I'll also be giving a talk on Metaprogramming, sitting on a panel, and generally participating for the whole 3 days. If you're there, feel free to draft me for an open-spaces discussion, or start a hallway conversation -- I'm going there because I want to talk about Python.

You can find out more about the conference, and register, here. There are also pre-conference tutorials beginning on June 28th.

Language Archaeology

What I found at the C++ committee meeting were most of the smartest people in the C++ community, gathered together in one place, available to answer my questions. I quickly realized this was far better than I could ever find in any graduate school program. And if you factor in the opportunity costs of graduate school, a far better deal financially as well.

I was hooked, and kept attending for about 8 years. The committee continued after I wandered away; the standard hadn't been completed yet but Java had appeared by that time and some others were also drifting off (It's the problem with being a technological stimulus junkie -- I do delve deep, but I'm always looking for more productivity leverage so it's not too hard to distract me with promising language features).

Each time we met, I would show up with a list of the thorniest C++ questions that had accumulated for me in the interim. I would usually have them all clarified within a couple of days. That, and being exposed to upcoming features early, was the most valuable short-term benefit of being on the committee.

In the long term, watching the addition of language features into the C++ puzzle was deep learning. It's easy now to monday-morning quarterback and say that C++ sucks and was badly designed, and many people do so without any understanding of the constraints under which it was designed. Whether or not it was entirely legitimate, Stroustrup's constraint was that a C program should compile with either trivial or (preferably) no changes under C++. This provided an easy evolution path for C programmers, but it was a big limitation and accounts for virtually every difficult feature that people complain about. But because those features are hard to understand, many people jump to the conclusion that C++ was badly designed, which is far from the truth.

Java fed this perception with its cavalier attitude about language design. I've written about this in Thinking in Java and in many weblogs, so longtime followers already know that Java tweaked me the wrong way from the start, because of the dismissive attitude of Gosling and the language designers. To be honest, my first "encounter" with Gosling left a bad taste in my mouth -- it was many years before, when I first began using Unix at one of the first companies I worked (Fluke, which makes electronic test equipment; I was doing embedded systems programming). One of the other software engineers was coaching me and had guided me towards emacs. But the only tool available in the company at that time was the commercial (Unipress) version of Gosling Emacs. And if you did something wrong, the program would insult you by calling you a turkey and filling the screen with garbage. This, in a commercial product for which the company had paid fair amounts of cash. Needless to say, as soon as Gnu emacs became stable the company switched over to that (I've met Richard Stallman. He's crazy, sure. But he's wicked smart, and smart enough to know that when you are in trouble, you need help, lots of it, and not insults).

I have no idea how much this formative experience with Gosling influenced my later feelings about his work, but the fact that the attitude about C++ was "we looked at it and it sucked so we decided to whip out a language of our own" didn't help. Especially when I began to tease it apart in the process of writing Thinking in Java and discovered, time after time, features and libraries where the decisions were slapdash -- indeed, most of these had to be repaired, sometimes after years of programmer suffering. And on numerous occasions Gosling admitted that they had to cut corners to hurry and get it out or else the internet revolution would have passed them by.

So the reason I'm giving this keynote is that I find it very helpful to understand why language features exist. If they're just handed to you on a platter by a college professor, you tend to develop a mythology around the language and to say "there's some really important reason for this language feature that the smart people who created the language understand and that I don't, so I'll just take it on faith." And at some point, faith-based acceptance of language features is a liability; it prevents you from being able to analyze and understand what's going on. In this keynote, I look at a number of features and examine how they are implemented in different languages, and why.

Here's an example: object creation. In C, you declare variables and the compiler creates stack space for you (uninitialized, containing garbage unless you initialize it). But if you want to do it dynamically, you must use the malloc() and free() standard library functions, and carefully perform all the initialization and cleanup by hand. If you forget, you have memory leaks and similar disasters, which happened frequently.

Because malloc() and free() were "only" library functions, and confusing and scary at that, they often didn't get taught in basic programming classes like they should have. And when programmers needed to allocate lots of memory, instead of learning about and dealing with these functions they would often (I kid you not) just allocate huge arrays of global variables, more than they ever thought they'd need. The program seemed to work, and no one would ever exceed those bounds anyway -- so when it did happen, years later, the program would break and some poor sod would have to go in and puzzle it out.

Stroustrup decided that dynamic allocation needed to be easier and safer -- it needed to be brought into the core of the language and not relegated to library functions. And it needed to be coupled with the same guaranteed initialization and cleanup that constructors and destructors provide for all objects.

The problem was the same millstone that dogged all C++ decisions: backward compatibility with C. Ideally, stack allocation of objects could simply have been discarded. But C compatibility required stack allocation, so there needed to be some way to distinguish heap objects from stack objects. To solve this problem, the new keyword was appropriated from Smalltalk. To create a stack object, you simply declare it, as in Cat x; or, with arguments, Cat x("mittens");. To create a heap object, you use new, as in new Cat; or new Cat("mittens");. Given the constraints, this is an elegant and consistent solution.

Enter Java, after deciding that everything C++ is badly done and overly complex. The irony here is that Java could and did make the decision to throw away stack allocation (pointedly ignoring the debacle of primitives, which I've addressed elsewhere). And since all objects are allocated on the heap, there's no need to distinguish between stack and heap allocation. They could easily have said Cat x = Cat() or Cat x = Cat("mittens"). Or even better, incorporated type inference to eliminate the repetition (but that -- and other features like closures -- would have taken "too long" so we are stuck with the mediocre version of Java instead; type inference has been discussed but I will lay odds it won't happen. And shouldn't, given the problems in adding new features to Java).

Guido Van Rossum (creator of Python) took a minimalist approach -- the oft-lambasted use of whitespace is an example of how clean he wanted the language. Since the new keyword wasn't necessary, he left it out, so you say x = Cat("mittens"). Ruby could have also used this approach, but one of Ruby's main constraints is that it follows Smalltalk as much as possible, so in Ruby you say x = Cat.new("mittens") (here's a nice introduction to Ruby). But Java made a point of dissing the C++ way of doing things, so the inclusion of the new keyword is a mystery. My guess, after studying decisions made in the rest of the language, is that it just never occurred to them that they could get away without it.

So that's what I mean about language archaeology. I have a list of other features for similar analysis during the keynote. I hope that people will come away with a better perspective on language design, and a more critical thought process when they are learning programming languages.

Metaprogramming

Ordinary programs manipulate data. Most of the time, ordinary programming is all you need. But sometimes you find yourself writing the same kind of code over and over, thus violating the most fundamental principle in programming: DRY ("Don't Repeat Yourself"). And yet, there doesn't seem to be any way in your programming language to fix the problem directly, so you are left duplicating code, knowing that your project continues to scatter this duplicated code throughout, and that if you need to change anything you're going to have to find every piece of duplicated code and fix it and test it over again. And on top of that, it's just plain inelegant.

This is where metaprogramming comes in. Metaprograms manipulate programs. Metaprogramming is code that modifies other code. So when you find yourself duplicating code, you can write a metaprogram and apply that instead, and you're back to following DRY.

Because metaprogramming is so clever and feels so powerful, it's easy to look for applications everywhere. It's worth repeating that most of the time, you don't need it. But when you do, it's amazingly useful.

This is why it keeps springing up, even in languages that really fight against code modification. In C++, which has no run-time model (everything compiles to raw code, another legacy of C compatibility), template metaprogramming appeared. Because it's such a struggle, template metaprogramming was very complex and almost no one figured out how to do it.

Java does have a runtime model and even a way to perform dynamic modifications on code, but the static type checking of the language is so onerous that raw metaprogramming was almost as hard to do as in C++ (I show these techniques in Thinking in Java). Clearly the need kept reasserting itself, because first we saw Aspect-Oriented Programming (AOP), which turned out to be a bit too complex for most programmers. Somehow, (and I'm kind of amazed that such a useful feature got through so late in Java's evolution), annotations got added, and these are really a metaprogramming construct -- annotations can even be used to modify code during compilation, much like C++ template metaprogramming (this form is more complex, but you don't need it as often). So far, annotations seem to be fairly successful, and have effectively replaced AOP.

Ruby takes a different approach, appropriate to Ruby's philosophy. Like Smalltalk, everything in Ruby is fungible (this is the very thing that makes dynamic languages so scary to folks who are used to static languages). I have no depth in Ruby metaprogramming, but as I understand it, it is just part of the language, with no extra constructs required. In combination with the optional-parameter syntax, it makes Ruby very attractive for creating Domain Specific Languages (DSLs), an example of which is Ruby on Rails.

Python also felt the pressure to support metaprogramming, which began to appear in 2.x versions of the language in the form of metaclasses. Metaclasses turned out to be (like AOP in Java) too much of a mental shift to allow easy use by mainstream Python programmers, so in the most recent versions of Python, decorators were added. These are similar in syntax to Java annotations, but more powerful in use, primarily because Python is as fungible as Ruby. What's interesting is that the intermediate step of actually applying the decorator turns out to be less of an intrusion, (as it might initially appear) but rather a beneficial annotation that makes the code more understandable. Indeed, one of the main problems with metaclasses (other than the complexity) was that you couldn't easily see by looking at the code what it does; you had to know that the magic had been folded in because of the metaclass. Whereas, with decorators, it is clear that metaprogramming actions are being applied to a function or class.

Although we haven't seen an explosion in the creation of DSLs in Python as we have in Ruby (it's certainly possible to create DSLs in Python), decorators provide an interesting alternative: instead of creating an entirely new language syntax, you can create a decorated version of Python. Although this might not be tightly targeted to domain users as DSLs are, it has the benefit of being more easily understandable to someone who is already familiar with Python (rather than learning a new syntax for each DSL).

Python decorators (both function and class decorators) have almost completely replaced the need for metaclasses, but there is still one obscure situation where metaclasses are still necessary, and this is when you must perform special activities as part of object creation, before initialization occurs. Thankfully, this situation tends to be a rather small edge case, so most people can get by using decorators for metaprogramming.

In the EuroPython presentation, I will be introducing metaprogramming with decorators, as well as demonstrating the special case where metaclasses are still necessary.


Michael Chermside

Posts: 17
Nickname: mcherm
Registered: Jan, 2004

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 16, 2009 1:54 PM
Reply to this message Reply
> But Java made a point of
> dissing the C++ way of doing things, so the inclusion of
> the new keyword is a mystery. My guess,
> after studying decisions made in the rest of the language,
> is that it just never occurred to them that they could get
> away without it.

I am fairly sure that the reason was a familiar one: backward compatibility with C++. I haven't discussed this with any of the designers of Java, but I WAS around when Java was first introduced, and I recall that much of the hype consisted of pointing out how you could take a program written in C++ and run it as Java with only minor changes to syntax. (In particular, the body of many functions remained identical.) I would say that the constraint they wrote for themselves was "looks like C++".

Now, "looks like" is a FAR less stringent constraint than "essentially all valid programs compile and run unchanged", which was the constraint that C++ took on. But it might have been the "sweet spot" in backward compatibility. I observe that a major portion of "wildly successful" languages (those that get widely used in industry by non-specialists) have taken on some form of backward compatibility as a constraint, so I have to assume that it plays an important role in the uptake of a language beyond the walls of academia. C++'s constraint (valid programs still run) is a strict standard to meet, but keeping the "new" keyword, the stupid format of switch statements and a few other such items may be a small price to pay if it did, indeed, help to bootstrap the popularity that Java achieved.

-- Michael Chermside
http://mcherm.com/

kost BebiX

Posts: 1
Nickname: kostbebix
Registered: Jun, 2009

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 16, 2009 2:23 PM
Reply to this message Reply
The situation is very often appears when you write some MVC web-app and you have like multiple controllers that do some work and after that they have to email you something important (like someone just bought something). And I guess metaprogramming with decorators is a good thing in here.

But here is a more complex situation that I don't really know how to solve: when you in your blog engine have, for example (as moderator), right to delete comments, you just go to delete controller and it deletes message and then does some business-logic for the deleted message. But then you want like option "delete multiple" when you just checkbox messages you want to delete and press the button. So you write new controller method that should do something similar, but something little different from that first case. So it's something like Scould be DRYer". The only DRY way here is to make a separate function for the deletion of one item and to call it multiple times, but that's not too good.

Bruce Eckel

Posts: 875
Nickname: beckel
Registered: Jun, 2003

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 16, 2009 3:04 PM
Reply to this message Reply
> I am fairly sure that the reason was a familiar one:
> backward compatibility with C++. I haven't discussed this
> with any of the designers of Java, but I WAS around
> when Java was first introduced, and I recall that much of
> the hype consisted of pointing out how you could take a
> program written in C++ and run it as Java with only minor
> changes to syntax. (In particular, the body of many
> functions remained identical.) I would say that the
> constraint they wrote for themselves was "looks like
> C++".

Although this is a compelling argument -- C++ had such a big uptake precisely because of C compatibility, so compatibility had been shown to be successful -- I have a hard time with it because so much else about the Java was very different. Still, the fundamental C syntax is very similar and that could definitely have been considered compelling. One issue people might be having with Scala is that its syntax can be quite different, even if it is very powerful.

Kay Schluehr

Posts: 302
Nickname: schluehk
Registered: Jan, 2005

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 16, 2009 6:34 PM
Reply to this message Reply
> So that's what I mean about language archaeology.

Me thinks language archaeology usually means something different. One reconstructs facts about programming languages from findings in implementations and code documentation as their "material" artifacts.

Mark Thornton

Posts: 275
Nickname: mthornton
Registered: Oct, 2005

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 17, 2009 1:00 AM
Reply to this message Reply
> compatibility had been shown to be successful -- I have a
> hard time with it because so much else about the Java was
> very different. Still, the fundamental C syntax is very

I feel that the importance of some of those Java differences isn't immediately obvious, and perhaps some of the differences are initially missed altogether by new comers to the language.

Vincent O'Sullivan

Posts: 724
Nickname: vincent
Registered: Nov, 2002

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 17, 2009 3:08 AM
Reply to this message Reply
> ...on numerous occasions Gosling
> admitted that they had to "cut corners to hurry and get it out or else the
> internet revolution would have passed them by".

That's an entirely laudible attitude and, given that Java is now the lingua franca of programming languages, an approach that certainly didn't fail. The problem is, however, that it only applies to version 1.0. All subsequent versions should address those "cut" corners and any new corners should be "cut" free. Yet, fourteen years and six versions leter, we still have date handling that is ,at best, antediluvian. Deprecated stuff that will never die. GUIs that always look like "my first GUI". Boilerplate that Brunel would have been proud of. Threads that snap if a fly land on them. Annotations that obscure, etc, etc.

James Watson

Posts: 2024
Nickname: watson
Registered: Sep, 2005

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 17, 2009 6:16 AM
Reply to this message Reply
> Boilerplate that Brunel would have been proud of.

This piqued my interest. Please elaborate.

> Annotations that obscure, etc, etc.

I've recently made my first foray into using annotations and while I can see why they are attractive, I'm not sure they are a good idea. What do you mean when you say they 'obscure'?

James Watson

Posts: 2024
Nickname: watson
Registered: Sep, 2005

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 17, 2009 6:22 AM
Reply to this message Reply
> In the long term, watching the addition of language
> features into the C++ puzzle was deep learning. It's easy
> now to monday-morning quarterback and say that C++ sucks
> and was badly designed, and many people do so without any
> understanding of the constraints under which it was
> designed.

What difference does it make? How a bad design came to be is little more than an excuse. It doesn't make the design any better. Are you suggesting that C++ would be a lot better if different constraints were chosen? And note that they were chosen, not forced upon anyone.

Achilleas Margaritis

Posts: 674
Nickname: achilleas
Registered: Feb, 2005

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 17, 2009 8:16 AM
Reply to this message Reply
C++ does not have flaws because of compatibility with C. C++ has flaws because it was not thought out well.

Mark Thornton

Posts: 275
Nickname: mthornton
Registered: Oct, 2005

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 17, 2009 11:03 AM
Reply to this message Reply
> > Boilerplate that Brunel would have been proud of.
>
> This piqued my interest. Please elaborate.

Isambard Kingdom Brunel, famous Victorian engineer.
http://www.bbc.co.uk/history/historic_figures/brunel_kingdom_isambard.shtml

Bill Pyne

Posts: 165
Nickname: billpyne
Registered: Jan, 2007

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 17, 2009 1:08 PM
Reply to this message Reply
I'm certainly not a C++ apologist - heck I haven't used it since 1998 and I wasn't very adept at it when I did. However, I think it did a remarkable job of introducing object-orientation to developers who were a) trained to procedural programming in college or b) trained in COBOL in industry. Constraints were both physical (hardware) and cultural.

With RAM still being measured in K for home computers and in single digit M for minis, languages had to produce a small, quick binary. Many people, competent C coders, still wrote assembly routines as a regular part of their C applications. For a new language to make it in industry, it did have to be compatible with C.

On a more cultural level, I talked with CS grad students in 1985 who were dying to use C - "it was going to take the industry by storm". Around 1994 I worked for a Boston area startup; C was our house language. One night I went to talk with a guy from our R&D wing, who was a recent graduate from a CS program, and he showed me C++. He was trying to analyze whether it was worth switching to C++ for the organization. He admitted to having a hard time with "wrapping his mind around" object orientation.

C++ did remarkably well at staying within hardware boundaries and making object-orientation a household name.

Bruce Eckel

Posts: 875
Nickname: beckel
Registered: Jun, 2003

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 17, 2009 3:58 PM
Reply to this message Reply
> C++ does not have flaws because of compatibility with C.
> C++ has flaws because it was not thought out well.

This is precisely what I'm arguing against. If you had been there as I was, you would have seen very smart people excruciatingly going over each decision, discovering all the problems before adding features. It was thought out *extremely* well, and the reason the language is difficult is precisely because of C compatibility.

Oh. Wait. You're trolling, aren't you. You got me. Good for you.

James Watson

Posts: 2024
Nickname: watson
Registered: Sep, 2005

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 17, 2009 6:49 PM
Reply to this message Reply
> > > Boilerplate that Brunel would have been proud of.
> >
> > This piqued my interest. Please elaborate.
>
> Isambard Kingdom Brunel, famous Victorian engineer.

Right, I know who he is. I see him as a personal hero. I'm curious about the "boilerplate" part.

Cedric Beust

Posts: 140
Nickname: cbeust
Registered: Feb, 2004

Re: Why? Language Archaeology ... and Metaprogramming Posted: Jun 17, 2009 7:57 PM
Reply to this message Reply
I actually agree with you for a change, Bruce :-)

I did a lot of C++ back in the days and I was also part of the committee for many years. This gave me the opportunity to see how things were happening from the inside, and my conclusions match yours: a lot of care and thoughts went into every single decision that was made on the language. Which is quite remarkable when you realize that dozens of commercial and personal interests were represented at each meeting, and even more so on the mailing-list and newsgroups.

Overall, I found that pragmatism prevailed in most cases and the decisions that were made were probably some of the best compromises you could reach given the extreme pressure imposed by backward compatibility constraints.

Having said that, the problem was close to unsolvable to start with, and even the best minds could not have defeated these odds.

How do you want your language? Efficient, backward compatible, clean: pick 2.

C++ had to pick the first two, there were just no other choices.

Having said that, Bruce, I still think that your snipes against Java are uncalled for, especially the part about `new`. Are you seriously trying to explain tell us that `new` is ok in Ruby but a proof of Java's weak design? Come on, now.

Interestingly, Java succeeded despite picking only one of the three choices above. Backward compatibility was not a concern (although familiarity probably played an important role in Java's design) and the language was dog slow in its early version.

However, it succeeded because by then, the complexity of C++ had reached the point of no return and the world was ready for a gentler version that wouldn't stray too for of the concepts put forth by C++ (most of which were pretty good, if you ask me).

Back to the original point of the article, I have to agree with Kay that "archaelogy" doesn't fit what you are trying to do here, Bruce. Maybe "spelunking" would be a more appropriate name, but at any rate, you should definitely try to become a bit more objective about Java before you embark on such an endeavor.

Flat View: This topic has 89 replies on 6 pages [ 1  2  3  4  5  6 | » ]
Topic: First Steps in Flex: 6 Screencasts Available Previous Topic   Next Topic Topic: A Generic Ostream Iterator

Sponsored Links



Google
  Web Artima.com   

Copyright © 1996-2019 Artima, Inc. All Rights Reserved. - Privacy Policy - Terms of Use