Skip to main content

Iterator Adapters in Rust

An Iterator that takes another iterator and returns a new one is called an iterator adapter. The name "adapter" comes from one of the GoF's design patterns, the adapter pattern. However, in reality, it corresponds more to the decorator pattern, so if you pay too much attention to the name, you might get confused about its purpose. So it's better not to worry too much about the name. Enough complaining about the name, what does an iterator adapter do?

An iterator adapter adds a task to be performed when the iterator iterates. This will be easier to understand when you see an example. The map function is one of the famous adapters. The iterator returned by the map function for those who have used functional languages iterates over new values transformed from the original values.

Besides, various adapters are already implemented in the standard library. Among them, the most frequently used are those that are convenient to use with loops. Examples include the filter that only returns values that meet the condition, take that returns only a specified number of values, skip that omits a few values and returns the rest, and step_by that iterates by skipping a few values. Using these adapters with loops can easily express complex condition handling.

In addition, cycle that makes it iterate forever without end, and inspect that only causes side effects without giving any transformation to the iterating values are also frequently used.

There is one thing to be careful about when using adapters. What the adapter returns is also an iterator. It does not perform the tasks specified by the adapter until the iterator is actually consumed. In other words, it performs lazy evaluation, which postpones execution until the value is actually needed. Therefore, the following code does not output any value on the screen because it does not use the iterator returned by inspect.

Then, there might be a question here. If the iterator spit out by the iterator adapter performs lazy evaluation, what happens to the iterator used as input to the adapter? In other languages which also implement the concept of iterator adapter, this can be a big problem. Fortunately, Rust prevents these kinds of problems from occurring using ownership. An iterator adapter is a function that takes an iterator and returns a new one. In other words, it takes ownership of the iterator. If it was a function that takes a reference to an iterator, it would have said that it borrows the iterator to create a new one. Therefore, the caller of the adapter can no longer use the iterator that was put into the adapter as an argument.

In this article, we introduced what an iterator adapter is and some commonly used adapters. In reality, there are many more adapters implemented in the standard library. At first glance, you might wonder where this will be used. But take a good look at the program you're creating now. There are surprisingly many cases where iterators are used. And among them, there are many cases where the code becomes cleaner when using an iterator adapter. Moreover, in Rust, problems arising from using iterator adapters in other languages do not occur, so there's no need to worry.


This article is translated from my post written in Korean. Since the post was written two years ago, there might be more sophisticated explanations for iterator adapters nowadays. However, this article seems still be sufficient to help understand iterator adapters.

Comments

Popular posts from this blog

Type Conversion in Rust

Type conversion is not special in Rust. It's just a function that takes ownership of the value and returns the other type. So you can name convert functions anything. However, it's a convention to use as_ , to_ , and into_ prefixed name or to use from_ prefixed constructor. From You can create any function for type conversion. However, if you want to provide generic interfaces, you'd better implement the From trait. For instance, you should implement From<X> for Y when you want the interface that converts the X type value to the Y type value. The From trait have an associated function named from . You can call this function like From::from(x) . You also can call it like Y::from(x) if the compiler cannot infer the type of the destination type. Into From have an associated function, it makes you be able to specify the destination type. It's why From has an associated function instead of a method, but on the other hands, you cannot use it as a me

Do not use garbage collection to catch memory leak

Garbage collection is a technique that automatically releases unnecessary memory. It's very famous because many programming languages adopted garbage collection after John McCarthy implemented it in Lisp. However, there are a few people who misunderstand what garbage collection does. If you think garbage collection prevents a memory leak, unfortunately, you are one of them. Garbage collection cannot prevent a memory leak. There is no way to avoid all memory leaks if you are using Turing-complete language. To understand it you should know what a memory leak is. Wikipedia describes a memory leak as the following: a type of resource leak that occurs when a computer program incorrectly manages memory allocations in such a way that memory which is no longer needed is not released. Briefly, a memory leak is a bug that doesn't release a memory that you don't use. So it is first to find the memory which will not be used in order to detect memory leaks. Unfortunately, it i

[C++] Handling Exceptions in Constructors

When you use RAII idiom, there are often situations where constructors have to do complex tasks. These complex tasks can sometimes fail, resulting in throwing exceptions. This raises a concern: Is it okay to throw exceptions in constructors? The first concern is memory leaks. Fortunately, memory leaks do not occur. Variables created on the stack are released through stack unwinding, and if an exception occurs during heap allocation with the new operator, the new operator automatically deallocates the memory and returns nullptr . The next concern is whether the destructor of the member variables will be called correctly. However, this is also not a problem. When an exception occurs, member variables can be divided into three categories: fully initialized member variables, member variables being initialized, and uninitialized member variables. Fully initialized member variables have had their constructors called and memory allocations completed successfully. In the example code, t