Skip to contentSkip to conversation

Could convert a buffer that allocated by vmalloc to pages?

DISCUSSION Yu-Chen Wu 3 participants 7 messages Jan 23, 2007

lore
Share & tools
lore

Yu-Chen Wu

author
#0 lore raw

Hi,
I write a driver have a big buffer (16MB,allocated by vmalloc). I want to use the buffer to do DMA transmission so I need getting the pages of the buffer.
Have any kernel API can do this?
My platform is x86_64 and 2GB RAM

THX

#1 lore raw
Quoted 6 lines · Yu-Chen Wu

Hi,
I write a driver have a big buffer (16MB,allocated by vmalloc). I want to use the buffer to do DMA transmission so I need getting the pages of the buffer.
Have any kernel API can do this?
My platform is x86_64 and 2GB RAM

vmalloc_to_page()...

See mm/memory.c for the function and how to use it.

Best regards,

Anton

Signature · 3 lines
Anton Altaparmakov <aia21 at cam.ac.uk> (replace at with @)
Unix Support, Computing Service, University of Cambridge, CB2 3QH, UK
Linux NTFS maintainer, http://www.linux-ntfs.org/
author
#2 lore raw

Hi Anton,
Thanks for r your answer.
I tried vmalloc_to_page() and I have some question.
I print the "pages" in vm_struct structure of the buffer to compare the address get from vmalloc_to_page(), result as follows:

//===source code==== L2cache=vmalloc(L2SIZE);// L2SIZE=40960 printk(KERN_INFO "find_vm_struct OK:%x addr:%xnr_pages:%d\n",L2vm,L2vm->addr,L2vm->nr_pages); for(i=0;i<L2vm->nr_pages;i++)

 {
      if(L2vm->pages[i])
         printk("page allocated:%x\n",page_address(L2vm->pages[i]));

}
tpage=vmalloc_to_page(L2cache); printk(KERN_INFO "vmalloc_to_page tpage :%x\n",tpage); //===========info of dmesg==================

[ 1561.768471] page allocated:73d65000
[ 1561.768474] page allocated:781e9000
[ 1561.768476] page allocated:6203f000
[ 1561.768478] page allocated:57fdf000
[ 1561.768481] page allocated:56ed4000
[ 1561.768483] page allocated:56ed5000
[ 1561.768485] page allocated:64ab6000
[ 1561.768488] page allocated:7cc1e000
[ 1561.768490] page allocated:60ea8000
[ 1561.768492] page allocated:60ea9000
[ 1561.768497] vmalloc_to_page tpage :7fcf7e18

Why the page address get from vmalloc_to_page is different with the first page address of the vm_struct (73d65000)?

THX
-----Original Message-----
From: [email protected] [mailto:[email protected]] On Behalf Of Anton Altaparmakov
Sent: Tuesday, January 23, 2007 9:12 PM
To: Yu-Chen Wu
Cc: [email protected]
Subject: Re: Could convert a buffer that allocated by vmalloc to pages?

Quoted 3 lines · Yu-Chen Wu

Hi,
I write a driver have a big buffer (16MB,allocated by vmalloc). I want to use the buffer to do DMA transmission so I need getting the

pages

Quoted 3 lines

of the buffer.
Have any kernel API can do this?
My platform is x86_64 and 2GB RAM

vmalloc_to_page()...

See mm/memory.c for the function and how to use it.

Best regards,

Anton

Signature · 9 lines
Anton Altaparmakov <aia21 at cam.ac.uk> (replace at with @)
Unix Support, Computing Service, University of Cambridge, CB2 3QH, UK
Linux NTFS maintainer, http://www.linux-ntfs.org/

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to [email protected]
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/
#3 lore raw
Quoted 3 lines · Yu-Chen Wu

I tried vmalloc_to_page() and I have some question.
I print the "pages" in vm_struct structure of the buffer to compare the address get from vmalloc_to_page(), result as follows:

Both the code you are showing and your question do not make any sense to me... You need to show all of the code not some random fragments... What the heck is L2vm for a start?

Best regards,

Anton

Quoted 53 lines

//===source code==== L2cache=vmalloc(L2SIZE);// L2SIZE=40960 printk(KERN_INFO "find_vm_struct OK:%x addr:%xnr_pages:%d\n",L2vm,L2vm->addr,L2vm->nr_pages); for(i=0;i<L2vm->nr_pages;i++)

 {
      if(L2vm->pages[i])
         printk("page allocated:%x\n",page_address(L2vm->pages[i]));

}
tpage=vmalloc_to_page(L2cache); printk(KERN_INFO "vmalloc_to_page tpage :%x\n",tpage); //===========info of dmesg==================

[ 1561.768471] page allocated:73d65000
[ 1561.768474] page allocated:781e9000
[ 1561.768476] page allocated:6203f000
[ 1561.768478] page allocated:57fdf000
[ 1561.768481] page allocated:56ed4000
[ 1561.768483] page allocated:56ed5000
[ 1561.768485] page allocated:64ab6000
[ 1561.768488] page allocated:7cc1e000
[ 1561.768490] page allocated:60ea8000
[ 1561.768492] page allocated:60ea9000
[ 1561.768497] vmalloc_to_page tpage :7fcf7e18

Why the page address get from vmalloc_to_page is different with the first page address of the vm_struct (73d65000)?

THX
-----Original Message-----
From: [email protected] [mailto:[email protected]] On Behalf Of Anton Altaparmakov
Sent: Tuesday, January 23, 2007 9:12 PM
To: Yu-Chen Wu
Cc: [email protected]
Subject: Re: Could convert a buffer that allocated by vmalloc to pages?

Quoted 3 lines · Yu-Chen Wu

Hi,
I write a driver have a big buffer (16MB,allocated by vmalloc). I want to use the buffer to do DMA transmission so I need getting the

pages

Quoted 3 lines

of the buffer.
Have any kernel API can do this?
My platform is x86_64 and 2GB RAM

vmalloc_to_page()...

See mm/memory.c for the function and how to use it.

Best regards,

Anton

Signature · 3 lines
Anton Altaparmakov <aia21 at cam.ac.uk> (replace at with @)
Unix Support, Computing Service, University of Cambridge, CB2 3QH, UK
Linux NTFS maintainer, http://www.linux-ntfs.org/
author
#4 lore raw

Hi Anton,
All of the code as below:
//==============================================
extern struct vm_struct *vmlist;
struct vm_struct *vmlist2,*L2vm;

int find_vm_struct(void *addr)

{
                struct vm_struct **p;
                int i;
                struct page *pg;
                printk("&vmlist=%x\n",&vmlist);
                for (p = &vmlist ; (L2vm = *p) != NULL ;p = &L2vm->next) {
                       if (L2vm->addr == addr)
                       goto found;
                }
                printk(KERN_INFO "find_vm_struct filed\n");
                return 0;
                found:
                printk(KERN_INFO "find_vm_struct OK:%x addr:%x
nr_pages:%d\n",L2vm,L2vm->addr,L2vm->nr_pages);
                for(i=0;i<L2vm->nr_pages;i++)
                {
                        if(L2vm->pages[i])
                                printk("page
allocated:%x\n",page_address(L2vm->pages[i]));
                }
                return 1;

}

static int __init mymodule_init()

{
        L2cache=vmalloc(40960);

        if(L2cache)
        {
                struct page *tpage;
                printk(KERN_INFO "L2 cache allocat success,
address:%x\n",L2cache);
                read_lock(&vmlist_lock);
                find_vm_struct(L2cache);
                read_unlock(&vmlist_lock);
                tpage=vmalloc_to_page(L2cache);
                printk(KERN_INFO "vmalloc_to_page tpage :%x\n",tpage);
        }
        else
        {
                printk(KERN_INFO "L2 cache allocat failed\n");
                return -1;
        }
        return 0;
}

//=============================================================== The mymodule_init() is the initial function of my moudle, it will call vmalloc to malloc a memory area(big buffer), the buffer will be used to do DMA transmission.
If allocated the buffer successfuly, it will find the vm_struct of the buffer, the address of vm_struct will be stored in L2vm.
If found the vm_struct, it will show all pages of the big buffer. You can see the page get from vmalloc_to_page() is different to all of the pages get form vm_struct.

Is it possible that the buffer allocated by vmalloc be used to do DMA transmission?

THX
-----Original Message-----
From: [email protected] [mailto:[email protected]] On Behalf Of Anton Altaparmakov
Sent: Tuesday, January 23, 2007 10:50 PM
To: Yu-Chen Wu
Cc: [email protected]
Subject: RE: Could convert a buffer that allocated by vmalloc to pages?

Quoted 3 lines · Yu-Chen Wu

I tried vmalloc_to_page() and I have some question.
I print the "pages" in vm_struct structure of the buffer to compare the address get from vmalloc_to_page(), result as follows:

Both the code you are showing and your question do not make any sense to me... You need to show all of the code not some random fragments... What the heck is L2vm for a start?

Best regards,

Anton

Quoted 24 lines

//===source code==== L2cache=vmalloc(L2SIZE);// L2SIZE=40960 printk(KERN_INFO "find_vm_struct OK:%x addr:%xnr_pages:%d\n",L2vm,L2vm->addr,L2vm->nr_pages); for(i=0;i<L2vm->nr_pages;i++)

 {
      if(L2vm->pages[i])
         printk("page allocated:%x\n",page_address(L2vm->pages[i]));

}
tpage=vmalloc_to_page(L2cache); printk(KERN_INFO "vmalloc_to_page tpage :%x\n",tpage); //===========info of dmesg==================

[ 1561.768471] page allocated:73d65000
[ 1561.768474] page allocated:781e9000
[ 1561.768476] page allocated:6203f000
[ 1561.768478] page allocated:57fdf000
[ 1561.768481] page allocated:56ed4000
[ 1561.768483] page allocated:56ed5000
[ 1561.768485] page allocated:64ab6000
[ 1561.768488] page allocated:7cc1e000
[ 1561.768490] page allocated:60ea8000
[ 1561.768492] page allocated:60ea9000
[ 1561.768497] vmalloc_to_page tpage :7fcf7e18
Quoted 7 lines

Why the page address get from vmalloc_to_page is different with the first page address of the vm_struct (73d65000)?

THX
-----Original Message-----
From: [email protected] [mailto:[email protected]] On Behalf Of Anton

Altaparmakov

Quoted 22 lines

Sent: Tuesday, January 23, 2007 9:12 PM
To: Yu-Chen Wu
Cc: [email protected]
Subject: Re: Could convert a buffer that allocated by vmalloc to pages?

Quoted 3 lines · Yu-Chen Wu

Hi,
I write a driver have a big buffer (16MB,allocated by vmalloc). I want to use the buffer to do DMA transmission so I need getting the

pages

Quoted 3 lines

of the buffer.
Have any kernel API can do this?
My platform is x86_64 and 2GB RAM

vmalloc_to_page()...

See mm/memory.c for the function and how to use it.

Best regards,

Anton

Signature · 8 lines
Anton Altaparmakov <aia21 at cam.ac.uk> (replace at with @)
Unix Support, Computing Service, University of Cambridge, CB2 3QH, UK
Linux NTFS maintainer, http://www.linux-ntfs.org/
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to [email protected]
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/
#5 lore raw

Hi,

Quoted 24 lines · Yu-Chen Wu

All of the code as below:
//==============================================
extern struct vm_struct *vmlist;
struct vm_struct *vmlist2,*L2vm;

int find_vm_struct(void *addr)

{
                struct vm_struct **p;
                int i;
                struct page *pg;
                printk("&vmlist=%x\n",&vmlist);
                for (p = &vmlist ; (L2vm = *p) != NULL ;p = &L2vm->next) {
                       if (L2vm->addr == addr)
                       goto found;
                }
                printk(KERN_INFO "find_vm_struct filed\n");
                return 0;
                found:
                printk(KERN_INFO "find_vm_struct OK:%x addr:%x
nr_pages:%d\n",L2vm,L2vm->addr,L2vm->nr_pages);
                for(i=0;i<L2vm->nr_pages;i++)
                {
                        if(L2vm->pages[i])
                                printk("page
Quoted 1 line

allocated:%x\n",page_address(L2vm->pages[i]));

You are printing "page_address()" of each of the pages here.

[snip]

Quoted 4 lines
                find_vm_struct(L2cache);
                read_unlock(&vmlist_lock);
                tpage=vmalloc_to_page(L2cache);
                printk(KERN_INFO "vmalloc_to_page tpage :%x\n",tpage);

You are printing "tpage" instead of page_address(tpage)" here so of course it will not be the same as what you did above where you printed the page_address() instead of the pages themselves...

Quoted 2 lines

Is it possible that the buffer allocated by vmalloc be used to do DMA transmission?

Only if you do it page by page as the pages are not physically contiguous, i.e. you would have to call vmalloc_to_page() for each page in the vmalloced area and then create a scatter-gather DMA operation working on each page in sequence. I suspect this is not what you want...

You will need to read up on doing DMA mappings from the kernel to learn how to make memory physicall contiguous. Hint start with reading Documentation/DMA-API.txt and DMA-mapping.txt...

Best regards,

Anton

Signature · 3 lines
Anton Altaparmakov <aia21 at cam.ac.uk> (replace at with @)
Unix Support, Computing Service, University of Cambridge, CB2 3QH, UK
Linux NTFS maintainer, http://www.linux-ntfs.org/
#6 lore raw
In reply to Yu-Chen Wu
Quoted 2 lines · Yu-Chen Wu

printk(KERN_INFO "vmalloc_to_page tpage :%x\n",tpage); //===========info of dmesg==================

<snip>

Quoted 6 lines
[ 1561.768492] page allocated:60ea9000
[ 1561.768497] vmalloc_to_page tpage :7fcf7e18

Why the page address get from vmalloc_to_page is different with the first page address of the vm_struct (73d65000)?

Memory returned by vmalloc is only virtually contiguous, not physically contiguous. If you're allocating memory for DMA, see the interface documented in Documentation/DMA-mapping.txt for more information.

-- Kyle