A few days ago I posted on here inquiring about different ways to achieve kernel bypass for networking. I've since concluded that I will definitely be using DPDK for it. I've found out that modern NICs actually have multiple packet queues and that today's linux kernel actually feeds packets from a NIC's queues into multiple threads, in order to process different packets (from individual packet queues in a NIC) in parallel. What I want to find out is whether DPDK does this parallel packet processing and if so, from a high level standpoint, how does it do it? Does DPDK simply have internal multithreading which in the end simply dumps as many packets at once into our userspace application's buffer, as it has been able to retrieve from the NIC, leaving any further multithreading setup and implementation completely to us, or does DPDK have a more intricate setup where it allows our application to give it the pthread_id of a thread, or something along those lines, and it will feed packets in parallel to our threads, instead of dumping them at once in our userspace memory buffer? submitted by /u/disassembler123 [link] [comments]
Are there any books or videos .From which I can understand the inner working of kernel .I just know extremely basic thing about kernel that it manages process and memory management .I want to learn more . submitted by /u/Abul_totaba [link] [comments]
Could someone with expertise in kernel bypass for networking, also known as writing a userspace NIC driver, show me some resources where I can start learning how to do it, or better yet - actually show me how to do it? I'm talking about the necessary code BEFORE the userspace driver is even able to read raw network packet data from the hardware network card, not the actual construction and parsing of packets - this I'll figure out myself. Good news is I'm pretty good at C programming, I have a side project that's several thousand lines of it. I'm also okay with assembly language code, had to work with it at my job developing a different operating system. My main problem is I don't know how to set up the initial software infrastructure, the specifics like PCIe, DMA, control registers, data sheets, etc are all new to me. Not only do I not know anything about those, I don't even know where to go learn how to do it. I found out about this, which seems to implement what I need in a thousand lines of C: https://github.com/emmericp/ixy It comes with a PDF that kinda explains it, but idk, still seems harder than what I've come here for - to find SOMEONE to show me / teach me how to do it. Any volunteers out there, I'd be very grateful. submitted by /u/disassembler123 [link] [comments]
Hi, How feasible is it to have a calling convention where the parameters are passed in a separate stack from the address stack? The advantages of this would be: 1) In the event of bugs etc, the parameters can't overwrite the return addresses. This would make stack overflow exploits a lot harder. 2) The CPU and CPU designers can make assumptions that the return address stack only contains addresses. This might make caching and lookahead easier. The disadvantages: 1) You need to manage another stack. But this might not be a big problem - nowadays many computers have lots of RAM and CPUs with billions of transistors. Best regards, 313243358d5ca7bcf6d4a0f12bc48e56d3f712a00b4c1d0fdd646cb9582602ad submitted by /u/noobposter123 [link] [comments]
hello, quick question, what does "runtime" mean in programming? for example, i can go to wikipedia and go to https://en.wikipedia.org/wiki/Runtime and it's giving me several different things that runtime could mean, so i wanted to ask, what is runtime to you? thank you submitted by /u/The_How_To_Linux [link] [comments]
You are more than welcome to disagree with the decisions and opinions expressed by anyone in the upstream community, including Linus, so long as you express your opinion on the matter in a measured and respectful way. This subreddit is to some degree meant to reflect the culture of the Linux kernel community. You can call it like you see it, and say things that may otherwise be considered somewhat “mean”, “prickly”, or overly direct in normal circles. In other words, for the most part, this community can reflect the tone and standards followed on LKML, and it will be fine. What we absolutely will not tolerate is calling anyone a derogatory slur, or make offensive comparisons that are grossly slanderous. For instance, do not call someone a nazi because you disagree with them, or compare them to Hitler. Doing so will result in an instant ban, no warning. It’s sad that this even needs to be said, but this latest unfortunate and understandably controversial news about banning Russian maintainers has resulted in some of the worst takes I’ve ever seen. That is all. submitted by /u/Byte_Lab [link] [comments]
Speaking from a demand perspective, what skill set is typically more needed by more companies? Of course the two disciplines are relatively niche and most companies don't need either. Regardless, I am curious to know! submitted by /u/skippermcdipper [link] [comments]
Is it viable to do kernel dev on wsl2 or not? I wish I could use arch which I have but games hold me back so I need something that is not as slow as a vm but fast and just works ootb aka wsl 2. TIA submitted by /u/unknownanonymoush [link] [comments]
Hi, I created a kernel module that implements a dynamic queue within a Kernel module for educational purposes. It supports IOCTL so that userspace programs may communicate with it. It might be helpful for beginners. Link: https://github.com/mirimmad/kernel-module submitted by /u/kcortex [link] [comments]
Hello everyone, I'm a master's student, soon to become a computer engineer. After a long journey searching for the right project idea for my degree, I knew I wanted to focus on something related to operating systems, low-level programming, or networking. However, I was unsure about the exact direction, especially since I now lean more toward software-oriented work. Recently, I came across an interesting theme: "Low-Latency Kernel Bypass Framework for High-Performance Networking." I'm considering pursuing this idea, but I have a few concerns. Is it feasible to complete within a one-year period? Also, would this project be a case of reinventing the wheel, given that some existing tools already perform similar tasks? if you have better project ideas please feel free to share them here! THANK YOU!! submitted by /u/ReynAURA [link] [comments]
ok, so i'm doing research for a new laptop, and when i look for a new laptop i like to get a laptop with two drives, one that is ssd for my linux operating system and another that is hdd for all my files, i like to encrypt both of them with two different passwords. now, i have been doing research into buying a new laptop, and i can't find any laptops with both a hdd and sdd, it's either one or the other. so i wanted to ask, is this a feature that linux's encryption "luks" can do for me? 1_can i make two paritions on the same sdd drive, 2_can it encrypt both when two different passwords 3_can one the operating system partition be unencrypted while my file partition be encrypted? 4_how can i do this? how can i set this up on my new laptop? what would i need to do when i format and install linux on my new laptop? submitted by /u/The_How_To_Linux [link] [comments]
Hi, I'm following the A Beginner's Guide to Linux Kernel Development (LFD103) course and I a bit confused about one part. According to the tutorial, I should be cloning : git clone git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git But after looking a bit at https://git.kernel.org/ there is no linux-stable.git There are : || || |kernel/git/stable/linux.git|Linux kernel stable treekernel/git/stable/linux.gitLinux kernel stable tree| || || |kernel/git/stable/linux-stable-rc.git|Linux Stable -rc releaseskernel/git/stable/linux-stable-rc.gitLinux Stable -rc releases| And I don't know which one is the correct one to use. Any help is appreciated. Thank you. submitted by /u/danielsannn5 [link] [comments]
How do you testrace conditions to see if the written logic works ? Or, in general how do mutex providers (kernel) test their code ? What are the involved tools ? How can I mimic a race to check a piece of code ? submitted by /u/Future-Equipment1153 [link] [comments]
I'm looking at an SoC with a reconfigurable L2 cache, some can be RAM some can be L2 and you can dynamically allocate it before any OS comes up. Its 2MB total but in reality the out of the box set up is 1MB as cache. Looking at the dt for the device its set as 2MB in the dt. I'm guessing this would have some impact on performance but the scale of the impact I'm not sure of. Can anyone explain what this might be? Linux thinking it has a 2MB L2 and actually only having 1MB. submitted by /u/ApprehensiveTowel541 [link] [comments]
Not sure if I can post this here, but I've been trying to compile an android kernel (source) and got this error: WARNING: vmlinux.o(.data+0x1f3288): Section mismatch in reference from the variable modem_spi_boot_driver to the function .init.text:modem_spi_boot_probe() The variable modem_spi_boot_driver references the function __init modem_spi_boot_probe() If the reference is valid then annotate the variable with __init* or __refdata (see linux/init.h) or name the variable: *_template, *_timer, *_sht, *_ops, *_probe, *_probe_one, *_console I'm not sure exactly what this means or what I would have to do to fix it. I'd really appreciate any help I could get. EDIT: just tried compiling the Pixel OS kernel (source) for the same phone and got the same error. It might not be an error with a kernel, but something wrong with my build environment instead. I'n not sure how I would fix that either. submitted by /u/AceYTX [link] [comments]
If a page is allocated using GFP_HIGHUSER, and its type is MIGRATE_UNMOVABLE as obtained through get_pageblock_migratetype, will this page be reclaimed? My current understanding is that as long as the page type is MIGRATE_UNMOVABLE, it will neither be migrated nor reclaimed. However, I'm not sure if this is correct. I've been searching online but haven't found a definitive answer, and I couldn't find any explanation in the official documentation either. I would greatly appreciate it if someone could clarify this for me. Thanks! submitted by /u/Suspicious-Pop1823 [link] [comments]
hello, i'm doing researching into process 0 and i can't seem to get answers on the most basic questions? what is process 0? what does it do? why does it do it? and so i wanted to ask here and ask what is process 0? i checked around online and found this https://blog.dave.tf/post/linux-pid0/ and this https://superuser.com/questions/377572/what-is-the-main-purpose-of-the-swapper-process-in-unix but i can't seem to get answers for basic questions, so i thought you guys might know thank you submitted by /u/The_How_To_Linux [link] [comments]
Does anyone know of something like a Thunderbird (or any other email application) plugin, configuration, template, etc. that enforces the Linux Kernel Mailing List conventions? In-line replies, plain text, possibly some integration with Git or syntax highlighting for patches. I have been manually composing and formatting replies in Vim, and then sending with git-send-email. It does the job, but gets really tedious. I'm sure most Linux kernel developers know some black magic to do all of the above with command line tools, but I'm very GUI-centric. submitted by /u/deep_nerd [link] [comments]