The limiting weak type behaviors and The lower bound for a new weak L log L type norm of strong maximal operators. It is well known that the weak ( 1,1 ) bounds doesn't hold for the strong maximal operators, but it still enjoys certain weak L log L type norm inequality. Let Phi n(t) t(1 ( log t) n 1 ) and the space L Phi n ( mathbb R n ) be the set of all measurable functions on mathbb R n such that f L Phi n ( mathbb R n ) Phi n( f ) L 1( mathbb R n ) infty . In this paper, we introduce a new weak norm space L Phi n 1, infty ( mathbb R n ) , which is more larger than L 1, infty ( mathbb R n ) space, and establish the correspondng limiting weak type behaviors of the strong maximal operators. As a corollary, we show that max 2 n ((n 1)!) 1 ,1 is a lower bound for the best constant of the L Phi n to L Phi n 1, infty norm of the strong maximal operators. Similar results have been extended to the multilinear strong maximal operators.


A computational geometry approach for modeling neuronal fiber pathways. We propose a novel and efficient algorithm to model high level topological structures of neuronal fibers. Tractography constructs complex neuronal fibers in three dimensions that exhibit the geometry of white matter pathways in the brain. However, most tractography analysis methods are time consuming and intractable. We develop a computational geometry based tractography representation that aims to simplify the connectivity of white matter fibers. Given the trajectories of neuronal fiber pathways, we model the evolution of trajectories that encodes geometrically significant events and calculate their point correspondence in the 3D brain space. Trajectory inter distance is used as a parameter to control the granularity of the model that allows local or global representation of the tractogram. Using diffusion MRI data from Alzheimer's patient study, we extract tractography features from our model for distinguishing the Alzheimer's subject from the normal control. Software implementation of our algorithm is available on GitHub.


Error analysis for 2D stochastic Navier Stokes equations in bounded domains. We study a finite element based space time discretisation for the 2D stochastic Navier Stokes equations in a bounded domain supplemented with no slip boundary conditions. We prove optimal convergence rates in the energy norm with respect to convergence in probability, that is convergence of order (almost) 1 2 in time and 1 in space. This was previously only known in the space periodic case, where higher order energy estimates for any given (deterministic) time are available. In contrast to this, in the Dirichlet case estimates are only known for a (possibly large) stopping time. We overcome this problem by introducing an approach based on discrete stopping times. This replaces the localised estimates (with respect to the sample space) from earlier contributions.


How can the nucleus be lighter than its constituents?. The fact that the nucleus is lighter than its constituents, seems rather strange. How can the whole have a smaller mass than its components? To get some intuition about how this is possible, one can look at a simpler more familiar system exhibiting the same phenomena the hydrogen atom. It turns out that the same is true here the hydrogen atom is a little bit lighter than the sum of its constituents. This difference corresponds to the ionisation energy of hydrogen. This observation allows a simple explanation for how this is possible the destructive interference between the electric fields of the proton and electron causes a reduction in the energy of the electric field and hence a reduction in the contribution to the mass of the system from the electric field energy. The same explanation can be extended to the nucleus, thus giving some intuition about how this mass reduction happens. In the process, the idea of classical particles being ball like objects with localised properties, is challenged.


The simplest erasing substitution. In this work, we begin the study of a new class of dynamical systems determined by interval maps generated by the symbolic action of erasing substitution rules. We do this by discussing in some detail the geometric, analytical, dynamical and arithmetic properties of a particular example, which has the virtue of being arguably the simplest and that at the same time produces interesting properties and new challenging problems.


Excitation of a homogeneous dielectric sphere by a point electric dipole. Electrically small dielectric antennas are of great interest for modern technologies, since they can significantly reduce the physical size of electronic devices for processing and transmitting information. We investigate the influence of the resonance conditions of an electrically small dielectric spherical antenna with a high refractive index on its directivity and analyze the dependence of these resonances on the effectively excited modes of the dielectric sphere.


A Matrix Related to Stern Polynomials and the Prouhet Thue Morse Sequence. The Stern polynomials defined by s(0 x) 0 , s(1 x) 1 , and for n geq 1 by s(2n x) s(n x 2) and s(2n 1 x) x ,s(n x 2) s(n 1 x 2) have only 0 and 1 as coefficients. We construct an infinite lower triangular matrix related to the coefficients of the s(n x) and show that its inverse has only 0, 1, and 1 as entries, which we find explicitly. In particular, the sign distribution of the entries is determined by the Prouhet Thue Morse sequence. We also obtain other properties of this matrix and a related Pascal type matrix that involve the Catalan, Stirling, Fibonacci, Fine, and Padovan numbers. Further results involve compositions of integers, the Sierpi 'nski matrix, and identities connecting the Stern and Prouhet Thue Morse sequences.


Refactoring for Reuse An Empirical Study. Refactoring is the de facto practice to optimize software health. While several studies propose refactoring strategies to optimize software design through applying design patterns and removing design defects, little is known about how developers actually refactor their code to improve its reuse. Therefore, we extract, from 1,828 open source projects, a set of refactorings that were intended to improve the software reusability. We analyze the impact of reusability refactorings on the state of the art reusability metrics, and we compare the distribution of reusability refactoring types, with the distribution of the remaining mainstream refactorings. Overall, we found that the distribution of refactoring types, applied in the context of reusability, is different from the distribution of refactoring types in mainstream development. In the refactorings performed to improve reusability, source files are subject to more design level types of refactorings. Reusability refactorings significantly impact, high level code elements, such as packages, classes, and methods, while typical refactorings, impact all code elements, including identifiers, and parameters. These findings provide practical insights into the current practice of refactoring in the context of code reuse involving the act of refactoring.


Quinary forms and paramodular forms. We work out the exact relationship between algebraic modular forms for a two by two general unitary group over a definite quaternion algebra, and those arising from genera of positive definite quinary lattices, relating stabilisers of local lattices with specific open compact subgroups, paramodular at split places, and with Atkin Lehner operators. Combining this with the recent work of R "osner and Weissauer, proving conjectures of Ibukiyama on Jacquet Langlands type correspondences (mildly generalised here), provides an effective tool for computing Hecke eigenvalues for Siegel modular forms of degree two and paramodular level. It also enables us to prove examples of congruences of Hecke eigenvalues connecting Siegel modular forms of degrees two and one. These include some of a type conjectured by Harder at level one, supported by computations of Fretwell at higher levels, and a subtly different congruence discovered experimentally by Buzzard and Golyshev.


Critical even unimodular lattices in the Gaussian core model. We consider even unimodular lattices which are critical for potential energy with respect to Gaussian potential functions in the manifold of lattices having point density 1. All even unimodular lattices up to dimension 24 are critical. We show how to determine the Morse index in these cases. While all these lattices are either local minima or saddle points, we find lattices in dimension 32 which are local maxima. Also starting from dimension 32 there are non critical even unimodular lattices.


Scaling Laws for Neural Machine Translation. We present an empirical study of scaling properties of encoder decoder Transformer models used in neural machine translation (NMT). We show that cross entropy loss as a function of model size follows a certain scaling law. Specifically (i) We propose a formula which describes the scaling behavior of cross entropy loss as a bivariate function of encoder and decoder size, and show that it gives accurate predictions under a variety of scaling approaches and languages we show that the total number of parameters alone is not sufficient for such purposes. (ii) We observe different power law exponents when scaling the decoder vs scaling the encoder, and provide recommendations for optimal allocation of encoder decoder capacity based on this observation. (iii) We also report that the scaling behavior of the model is acutely influenced by composition bias of the train test sets, which we define as any deviation from naturally generated text (either via machine generated or human translated text). We observe that natural text on the target side enjoys scaling, which manifests as successful reduction of the cross entropy loss. (iv) Finally, we investigate the relationship between the cross entropy loss and the quality of the generated translations. We find two different behaviors, depending on the nature of the test data. For test sets which were originally translated from target language to source language, both loss and BLEU score improve as model size increases. In contrast, for test sets originally translated from source language to target language, the loss improves, but the BLEU score stops improving after a certain threshold. We release generated text from all models used in this study.


Global attractivity for a nonautonomous Nicholson's equation with mixed monotonicities. We consider a Nicholson's equation with multiple pairs of time varying delays and nonlinear terms given by mixed monotone functions. Sufficient conditions for the permanence, local stability and global attractivity of its positive equilibrium are established. Our criteria depend on the size of some delays, improve results in recent literature and provide answers to some open problems.


UnDiFi 2D an Unstructured Discontinuity Fitting code for 2D grids. UnDiFi 2D, an open source (free software) Unstructured grid, Discontinuity Fitting code, is presented. The aim of UnDiFi 2D is to model gas dynamic discontinuities in two dimensional (2D) flows as if they were true discontinuities of null thickness that bound regions of the flow field where a smooth solution to the governing PDEs exists. UnDiFi 2D therefore needs to be coupled with an unstructured CFD solver that is used to discretize the governing PDEs within the smooth regions of the flow field. Two different, in house developed, CFD solvers are also included in the current distribution. The main features of the UnDiFi 2D software can be summarized as follows Programming Language UnDiFi 2D is written in standard Fortran 77 95 its design is highly modular in order to enhance simplicity of use, maintenance and allow coupling with virtually any existing CFD solver Usability, Maintenance and Enhancement In order to improve the usability, maintenance and enhancement of the code also the documentation has been carefully taken into account. The git distributed versioning system has been adopted to facilitate collaborative maintenance and code development Copyrights UnDiFi 2D is a free software that anyone can use, copy, distribute, change and improve under the GNU Public License version 3. The present paper is a manifesto of the first public release of the UnDiFi 2D code. It describes the currently implemented features, which are the result of more than a decade of still ongoing CFD developments. This work is focused on the computational techniques adopted and a detailed description of the main characteristics is reported. UnDiFi 2D capabilities are demonstrated by means of examples test cases. The design of the code allows to easily include existing CFD codes and is aimed at ease code reuse and readability.


Multi Objective Graph Heuristic Search for Terrestrial Robot Design. We present methods for co designing rigid robots over control and morphology (including discrete topology) over multiple objectives. Previous work has addressed problems in single objective robot co design or multi objective control. However, the joint multi objective co design problem is extremely important for generating capable, versatile, algorithmically designed robots. In this work, we present Multi Objective Graph Heuristic Search, which extends a single objective graph heuristic search from previous work to enable a highly efficient multi objective search in a combinatorial design topology space. Core to this approach, we introduce a new universal, multi objective heuristic function based on graph neural networks that is able to effectively leverage learned information between different task trade offs. We demonstrate our approach on six combinations of seven terrestrial locomotion and design tasks, including one three objective example. We compare the captured Pareto fronts across different methods and demonstrate that our multi objective graph heuristic search quantitatively and qualitatively outperforms other techniques.


SAMCNet for Spatial configuration based Classification A Summary of Results. The goal of spatial configuration based classification is to build a classifier to distinguish two classes (e.g., responder, non responder) based on the spatial arrangements (e.g., spatial interactions between different point categories) given multi category point data from two classes. This problem is important for generating hypotheses in medical pathology towards discovering new immunotherapies for cancer treatment as well as for other applications in biomedical research and microbial ecology. This problem is challenging due to an exponential number of category subsets which may vary in the strength of spatial interactions. Most prior efforts on using human selected spatial association measures may not be sufficient for capturing the relevant (e.g., surrounded by) spatial interactions which may be of biological significance. In addition, the related deep neural networks are limited to category pairs and do not explore larger subsets of point categories. To overcome these limitations, we propose a Spatial interaction Aware Multi Category deep neural Network (SAMCNet) architecture and contribute novel local reference frame characterization and point pair prioritization layers for spatial configuration based classification. Extensive experimental results on multiple cancer datasets show that the proposed architecture provides higher prediction accuracy over baseline methods.


Time Dependent Third Order Nonlinear Optical Susceptibility Tensor Components of the Carbon Disulfide Molecule using Femtosecond Degenerate Four Wave Mixing. We report time resolved studies and measurement of all the components of the third order nonlinear optical susceptibility of CS2 at 515 nm using degenerate four wave mixing. The use of a pulse of width 450 fs, which is comparable to the time scale of the molecular reorientation dynamics of CS2 makes our study unique. Given the wide use of this molecule as a reference material, our results will not only be a useful addition to the data base of the nonlinear optical properties of CS2, but also provide additional insights into the time dynamics of the nonlinear processes involved. These results emphasize the importance of the time scales and wavelengths used to report the nonlinear optical susceptibility values for the reference material too.


Coloring the Black Box What Synesthesia Tells Us about Character Embeddings. In contrast to their word or sentence level counterparts, character embeddings are still poorly understood. We aim at closing this gap with an in depth study of English character embeddings. For this, we use resources from research on grapheme color synesthesia a neuropsychological phenomenon where letters are associated with colors, which give us insight into which characters are similar for synesthetes and how characters are organized in color space. Comparing 10 different character embeddings, we ask How similar are character embeddings to a synesthete's perception of characters? And how similar are character embeddings extracted from different models? We find that LSTMs agree with humans more than transformers. Comparing across tasks, grapheme to phoneme conversion results in the most human like character embeddings. Finally, ELMo embeddings differ from both humans and other models.


Symbolic Reinforcement Learning for Safe RAN Control. In this paper, we demonstrate a Symbolic Reinforcement Learning (SRL) architecture for safe control in Radio Access Network (RAN) applications. In our automated tool, a user can select a high level safety specifications expressed in Linear Temporal Logic (LTL) to shield an RL agent running in a given cellular network with aim of optimizing network performance, as measured through certain Key Performance Indicators (KPIs). In the proposed architecture, network safety shielding is ensured through model checking techniques over combined discrete system models (automata) that are abstracted through reinforcement learning. We demonstrate the user interface (UI) helping the user set intent specifications to the architecture and inspect the difference in allowed and blocked actions.


Optimizing Oblique Projections for Nonlinear Systems using Trajectories. Reduced order modeling techniques, including balanced truncation and mathcal H 2 optimal model reduction, exploit the structure of linear dynamical systems to produce models that accurately capture the dynamics. For nonlinear systems operating far away from equilibria, on the other hand, current approaches seek low dimensional representations of the state that often neglect low energy features that have high dynamical significance. For instance, low energy features are known to play an important role in fluid dynamics where they can be a driving mechanism for shear layer instabilities. Neglecting these features leads to models with poor predictive accuracy despite being able to accurately encode and decode states. In order to improve predictive accuracy, we propose to optimize the reduced order model to fit a collection of coarsely sampled trajectories from the original system. In particular, we optimize over the product of two Grassmann manifolds defining Petrov Galerkin projections of the full order governing equations. We compare our approach with existing methods including proper orthogonal decomposition, balanced truncation based Petrov Galerkin projection, quadratic bilinear balanced truncation, and the quadratic bilinear iterative rational Krylov algorithm. Our approach demonstrates significantly improved accuracy both on a nonlinear toy model and on an incompressible (nonlinear) axisymmetric jet flow with 10 5 states.


Correction of FLASH based MT saturation in human brain for residual bias of B1 inhomogeneity at 3T. Background Magnetization transfer (MT) saturation reflects the additional saturation of the MRI signal imposed by an MT pulse and is largely driven by the saturation of the bound pool. This reduction of the bound polarization by the MT pulse is less efficient than predicted by the differential B1 square law of absorption. Thus, B1 inhomogeneities lead to a residual bias in the MT saturation maps. We derive a heuristic correction to reduce this bias for a widely used multi parameter mapping protocol at 3T. Methods The amplitude of the MT pulse was varied via the nominal flip angle to mimic variations in B1. The MT saturation's dependence on the actual flip angle features a linear correction term, which was determined separately for gray and white matter. Results The deviation of MT saturation from differential B1 square law is well described by a linear decrease with the actual flip angle of the MT pulse. This decrease showed no significant differences between gray and white matter. Thus, the post hoc correction does not need to take different tissue types into account. Bias corrected MT saturation maps appeared more symmetric and highlighted highly myelinated tracts. Discussion Our correction involves a calibration that is specific for the MT pulse. While it can also be used to rescale nominal flip angles, different MT pulses and or protocols will require individual calibration. Conclusion The suggested B1 correction of the MT maps can be applied post hoc using an independently acquired flip angle map.


Polynomial Approximation of Symmetric Functions. We study the polynomial approximation of symmetric multivariate functions and of multi set functions. Specifically, we consider f(x 1, dots, x N) , where x i in mathbb R d , and f is invariant under permutations of its N arguments. We demonstrate how these symmetries can be exploited to improve the cost versus error ratio in a polynomial approximation of the function f , and in particular study the dependence of that ratio on d, N and the polynomial degree. These results are then used to construct approximations and prove approximation rates for functions defined on multi sets where N becomes a parameter of the input.


Regularization by inexact Krylov methods with applications to blind deblurring. This paper is concerned with the regularization of large scale discrete inverse problems by means of inexact Krylov methods. Specifically, we derive two new inexact Krylov methods that can be efficiently applied to unregularized or Tikhonov regularized least squares problems, and we study their theoretical properties, including links with their exact counterparts and strategies to monitor the amount of inexactness. We then apply the new methods to separable nonlinear inverse problems arising in blind deblurring. In this setting inexactness stems from the uncertainty in the parameters defining the blur, which may be recovered using a variable projection method leading to an inner outer iteration scheme (i.e., one cycle of inner iterations is performed to solve one linear deblurring subproblem for any intermediate values of the blurring parameters computed by a nonlinear least squares solver). The new inexact solvers can naturally handle varying inexact blurring parameters while solving the linear deblurring subproblems, allowing for a much reduced number of total iterations and substantial computational savings with respect to their exact counterparts.


An upwind DG scheme preserving the maximum principle for the convective Cahn Hilliard model. The design of numerical approximations of the Cahn Hilliard model preserving the maximum principle is a challenging problem, even more if considering additional transport terms. In this work we present a new upwind Discontinuous Galerkin scheme for the convective Cahn Hilliard model with degenerate mobility which preserves the maximum principle and prevents non physical spurious oscillations. Furthermore, we show some numerical experiments in agreement with the previous theoretical results. Finally, numerical comparisons with other schemes found in the literature are also carried out.


On the underlying drag reduction mechanisms of flow control strategies in a transitional channel flow temporal approach. The underlying mechanisms of three different flow control strategies on drag reduction in a channel flow are investigated by direct numerical simulations at friction Reynolds numbers ranging from 65 to 85. These strategies include the addition of long chain polymers, the incorporation of slip surfaces, and the application of an external body force. While it has been believed that such methods lead to a skin friction reduction by controlling near wall flow structures, the underlying mechanisms at play are still not as clear. In this study, a temporal analysis is employed to elucidate underlying drag reduction mechanisms among these methods. The analysis is based on the lifetime of intermittent phases represented by the active and hibernating phases of a minimal turbulent channel flow (Xi Graham, Phy. Rev. Lett. 2010). At a similar amount of drag reduction, the polymer and slip methods show a similar mechanism, while the body force method is different. The polymers and slip surfaces cause hibernating phases to happen more frequently, while the duration of active phases is decreased. However, the body forces cause hibernating phases to happen less frequently but prolong its duration to achieve a comparable amount of drag reduction. A possible mechanism behind the body force method is associated with its unique roller like vortical structures formed near the wall. These structures appear to prevent interactions between inner and outer regions by which hibernating phases are prolonged. It should motivate adaptive flow control strategies to exploit the distinct underlying mechanisms for robust control of turbulent drag at low Reynolds numbers.


Reinforced Meta path Selection for Recommendation on Heterogeneous Information Networks. Heterogeneous Information Networks (HINs) capture complex relations among entities of various kinds and have been used extensively to improve the effectiveness of various data mining tasks, such as in recommender systems. Many existing HIN based recommendation algorithms utilize hand crafted meta paths to extract semantic information from the networks. These algorithms rely on extensive domain knowledge with which the best set of meta paths can be selected. For applications where the HINs are highly complex with numerous node and link types, the approach of hand crafting a meta path set is too tedious and error prone. To tackle this problem, we propose the Reinforcement learning based Meta path Selection (RMS) framework to select effective meta paths and to incorporate them into existing meta path based recommenders. To identify high quality meta paths, RMS trains a reinforcement learning (RL) based policy network(agent), which gets rewards from the performance on the downstream recommendation tasks. We design a HIN based recommendation model, HRec, that effectively uses the meta path information. We further integrate HRec with RMS and derive our recommendation solution, RMS HRec, that automatically utilizes the effective meta paths. Experiments on real datasets show that our algorithm can significantly improve the performance of recommendation models by capturing important meta paths automatically.


PlumeCityNet Multi Resolution Air Quality Forecasting. This paper presents an engine able to forecast jointly the concentrations of the main pollutants harming people's health nitrogen dioxide (NO2), ozone (O3) and particulate matter (PM2.5 and PM10, which are respectively the particles whose diameters are below 2.5um and 10um respectively). The engine is fed with air quality monitoring stations' measurements, weather forecasts, physical models' outputs and traffic estimates to produce forecasts up to 24 hours. The forecasts are produced with several spatial resolutions, from a few dozens of meters to dozens of kilometers, fitting several use cases needing air quality data. We introduce the Scale Unit block, which enables to integrate seamlessly all available inputs at a given resolution to return forecasts at the same resolution. Then, the engine is based on a U Net architecture built with several of those blocks, giving it the ability to process inputs and to output predictions at different resolutions. We have implemented and evaluated the engine on the largest cities in Europe and the United States, and it clearly outperforms other prediction methods. In particular, the out of sample accuracy remains high, meaning that the engine can be used in cities which are not included in the training dataset. A valuable advantage of the engine is that it does not need much computing power the forecasts can be built in a few minutes on a standard CPU. Thus, they can be updated very frequently, as soon as new air quality monitoring stations' measurements are available (generally every hour), which is not the case of physical models traditionally used for air quality forecasting.


Temporal Relational Hypergraph Tri Attention Networks for Stock Trend Prediction. Predicting the future price trends of stocks is a challenging yet intriguing problem given its critical role to help investors make profitable decisions. In this paper, we present a collaborative temporal relational modeling framework for end to end stock trend prediction. The temporal dynamics of stocks is firstly captured with an attention based recurrent neural network. Then, different from existing studies relying on the pairwise correlations between stocks, we argue that stocks are naturally connected as a collective group, and introduce the hypergraph structures to jointly characterize the stock group wise relationships of industry belonging and fund holding. A novel hypergraph tri attention network (HGTAN) is proposed to augment the hypergraph convolutional networks with a hierarchical organization of intra hyperedge, inter hyperedge, and inter hypergraph attention modules. In this manner, HGTAN adaptively determines the importance of nodes, hyperedges, and hypergraphs during the information propagation among stocks, so that the potential synergies between stock movements can be fully exploited. Extensive experiments on real world data demonstrate the effectiveness of our approach. Also, the results of investment simulation show that our approach can achieve a more desirable risk adjusted return. The data and codes of our work have been released at https github.com lixiaojieff HGTAN.


An Empirical Study of Configuration Mismatches in Linux. Ideally the variability of a product line is represented completely and correctly by its variability model. However, in practice additional variability is often represented on the level of the build system or in the code. Such a situation may lead to inconsistencies, where the actually realized variability does not fully correspond to the one described by the variability model. In this paper we focus on configuration mismatches, i.e., cases where the effective variability differs from the variability as it is represented by the variability model. While previous research has already shown that these situations still exist even today in well analyzed product lines like Linux, so far it was unclear under what circumstances such issues occur in reality. In particular, it is open what types of configuration mismatches occur and how severe they are. Here, our contribution is to close this gap by presenting a detailed manual analysis of 80 configuration mismatches in the Linux 4.4.1 kernel and assess their criticality. We identify various categories of configuration issues and show that about two thirds of the configuration mismatches may actually lead to kernel misconfigurations.


Data Centric and Data Aware Frameworks for Fundamentally Efficient Data Handling in Modern Computing Systems. There is an explosive growth in the size of the input and or intermediate data used and generated by modern and emerging applications. Unfortunately, modern computing systems are not capable of handling large amounts of data efficiently. Major concepts and components (e.g., the virtual memory system) and predominant execution models (e.g., the processor centric execution model) used in almost all computing systems are designed without having modern applications' overwhelming data demand in mind. As a result, accessing, moving, and processing large amounts of data faces important challenges in today's systems, making data a first class concern and a prime performance and energy bottleneck in such systems. This thesis studies the root cause of inefficiency in modern computing systems when handling modern applications' data demand, and aims to fundamentally address such inefficiencies, with a focus on two directions. First, we design SIMDRAM, an end to end processing using DRAM framework that aids the widespread adoption of processing using DRAM, a data centric computation paradigm that improves the overall performance and efficiency of the system when computing large amounts of data by minimizing the cost of data movement and enabling computation where the data resides. Second, we introduce the Virtual Block Interface (VBI), a novel virtual memory framework that 1) eliminates the inefficiencies of the conventional virtual memory frameworks when handling the high memory demand in modern applications, and 2) is built from the ground up to understand, convey, and exploit data properties, to create opportunities for performance and efficiency improvements.


Robbing the Fed Directly Obtaining Private Data in Federated Learning with Modified Models. Federated learning has quickly gained popularity with its promises of increased user privacy and efficiency. Previous works have shown that federated gradient updates contain information that can be used to approximately recover user data in some situations. These previous attacks on user privacy have been limited in scope and do not scale to gradient updates aggregated over even a handful of data points, leaving some to conclude that data privacy is still intact for realistic training regimes. In this work, we introduce a new threat model based on minimal but malicious modifications of the shared model architecture which enable the server to directly obtain a verbatim copy of user data from gradient updates without solving difficult inverse problems. Even user data aggregated over large batches where previous methods fail to extract meaningful content can be reconstructed by these minimally modified models.


Polyhedral realizations for B( infty) and extended Young diagrams, Young walls of type rm A (1) n 1 , rm C (1) n 1 , rm A (2) 2n 2 , rm D (2) n . The crystal bases are quite useful combinatorial tools to study the representations of quantized universal enveloping algebras U q( mathfrak g ) . The polyhedral realization for B( infty) is a combinatorial description of the crystal base, which is defined as an image of embedding Psi iota B( infty) hookrightarrow mathbb Z infty iota , where iota is an infinite sequence of indices and mathbb Z infty iota is an infinite mathbb Z lattice with a crystal structure associated with iota . It is a natural problem to find an explicit form of the polyhedral realization rm Im ( Psi iota ) . In this article, supposing that mathfrak g is of affine type rm A (1) n 1 , rm C (1) n 1 , rm A (2) 2n 2 or rm D (2) n and iota satisfies the condition of adaptedness', we describe rm Im ( Psi iota ) by using several combinatorial objects such as extended Young diagrams and Young walls.


Technical Language Supervision for Intelligent Fault Diagnosis in Process Industry. In the process industry, condition monitoring systems with automated fault diagnosis methods assisthuman experts and thereby improve maintenance efficiency, process sustainability, and workplace safety.Improving the automated fault diagnosis methods using data and machine learning based models is a centralaspect of intelligent fault diagnosis (IFD). A major challenge in IFD is to develop realistic datasets withaccurate labels needed to train and validate models, and to transfer models trained with labeled lab datato heterogeneous process industry environments. However, fault descriptions and work orders written bydomain experts are increasingly digitized in modern condition monitoring systems, for example in the contextof rotating equipment monitoring. Thus, domain specific knowledge about fault characteristics and severitiesexists as technical language annotations in industrial datasets. Furthermore, recent advances in naturallanguage processing enable weakly supervised model optimization using natural language annotations, mostnotably in the form ofnatural language supervision(NLS). This creates a timely opportunity to developtechnical language supervision(TLS) solutions for IFD systems grounded in industrial data, for exampleas a complement to pre training with lab data to address problems like overfitting and inaccurate out of sample generalisation. We surveyed the literature and identify a considerable improvement in the maturityof NLS over the last two years, facilitating applications beyond natural language a rapid development ofweak supervision methods and transfer learning as a current trend in IFD which can benefit from thesedevelopments. Finally, we describe a framework for integration of TLS in IFD which is inspired by recentNLS innovations.


Good Artists Copy, Great Artists Steal Model Extraction Attacks Against Image Translation Generative Adversarial Networks. Machine learning models are typically made available to potential client users via inference APIs. Model extraction attacks occur when a malicious client uses information gleaned from queries to the inference API of a victim model F V to build a surrogate model F A that has comparable functionality. Recent research has shown successful model extraction attacks against image classification, and NLP models. In this paper, we show the first model extraction attack against real world generative adversarial network (GAN) image translation models. We present a framework for conducting model extraction attacks against image translation models, and show that the adversary can successfully extract functional surrogate models. The adversary is not required to know F V 's architecture or any other information about it beyond its intended image translation task, and queries F V 's inference interface using data drawn from the same domain as the training data for F V . We evaluate the effectiveness of our attacks using three different instances of two popular categories of image translation (1) Selfie to Anime and (2) Monet to Photo (image style transfer), and (3) Super Resolution (super resolution). Using standard performance metrics for GANs, we show that our attacks are effective in each of the three cases the differences between F V and F A , compared to the target are in the following ranges Selfie to Anime FID 13.36 68.66 , Monet to Photo FID 3.57 4.40 , and Super Resolution SSIM 0.06 0.08 and PSNR 1.43 4.46 . Furthermore, we conducted a large scale (125 participants) user study on Selfie to Anime and Monet to Photo to show that human perception of the images produced by the victim and surrogate models can be considered equivalent, within an equivalence bound of Cohen's d 0.3 .


Prime Probe 1, JavaScript 0 Overcoming Browser based Side Channel Defenses. The "eternal war in cache" has reached browsers, with multiple cache based side channel attacks and countermeasures being suggested. A common approach for countermeasures is to disable or restrict JavaScript features deemed essential for carrying out attacks. To assess the effectiveness of this approach, in this work we seek to identify those JavaScript features which are essential for carrying out a cache based attack. We develop a sequence of attacks with progressively decreasing dependency on JavaScript features, culminating in the first browser based side channel attack which is constructed entirely from Cascading Style Sheets (CSS) and HTML, and works even when script execution is completely blocked. We then show that avoiding JavaScript features makes our techniques architecturally agnostic, resulting in microarchitectural website fingerprinting attacks that work across hardware platforms including Intel Core, AMD Ryzen, Samsung Exynos, and Apple M1 architectures. As a final contribution, we evaluate our techniques in hardened browser environments including the Tor browser, Deter Fox (Cao el al., CCS 2017), and Chrome Zero (Schwartz et al., NDSS 2018). We confirm that none of these approaches completely defend against our attacks. We further argue that the protections of Chrome Zero need to be more comprehensively applied, and that the performance and user experience of Chrome Zero will be severely degraded if this approach is taken.


Robust Robotic Control from Pixels using Contrastive Recurrent State Space Models. Modeling the world can benefit robot learning by providing a rich training signal for shaping an agent's latent state space. However, learning world models in unconstrained environments over high dimensional observation spaces such as images is challenging. One source of difficulty is the presence of irrelevant but hard to model background distractions, and unimportant visual details of task relevant entities. We address this issue by learning a recurrent latent dynamics model which contrastively predicts the next observation. This simple model leads to surprisingly robust robotic control even with simultaneous camera, background, and color distractions. We outperform alternatives such as bisimulation methods which impose state similarity measures derived from divergence in future reward or future optimal actions. We obtain state of the art results on the Distracting Control Suite, a challenging benchmark for pixel based robotic control.


Domain Adaptation and Multi Domain Adaptation for Neural Machine Translation A Survey. The development of deep learning techniques has allowed Neural Machine Translation (NMT) models to become extremely powerful, given sufficient training data and training time. However, systems struggle when translating text from a new domain with a distinct style or vocabulary. Fine tuning on in domain data allows good domain adaptation, but requires sufficient relevant bilingual data. Even if this is available, simple fine tuning can cause overfitting to new data and catastrophic forgetting' of previously learned behaviour. We concentrate on robust approaches to domain adaptation for NMT, particularly where a system may need to translate across multiple domains. We divide techniques into those revolving around data selection or generation, model architecture, parameter adaptation procedure, and inference procedure. We finally highlight the benefits of domain adaptation and multi domain adaptation techniques to other lines of NMT research.


Low emittance muon beam in the 2 to 40 GeV energy range for muon and neutrino experiments. I present a scheme to obtain a 2 to 40 GeV low emittance muon beam, not requiring cooling and within today's technological resources, to be used for early commissioning of muon accelerator projects, or alternatively dedicated muon and neutrino parameter measurements. In particular, a muon rate of 5x10 4 mu s in a normalized transverse emittance of 5 um at 22 GeV, and energy spread of 1 GeV obtained from O(10 11) e s on target at 44 GeV. This emittance is below the expected results of advanced emittance cooling techniques for muons produced from protons on target, and represents an alternative for the duration of complete muon cooling studies. The scheme has beam designed to adjust the muon beam energy in the GeV energy range to the needs for precise parameter measurements of muons and neutrinos. Although the rate is small compared to other muon sources, it does not seem to represent a big limitation for its usage. Furthermore, the muon rate could be in principle increased proportionally to the availability of higher positron rates, already foreseen for future collider projects.


A Comparative Synthesis Approach to Optimal Network Designs with Indeterminate Objectives. When managing wide area networks, network architects must decide how to balance multiple conflicting metrics, and ensure fair allocations to competing traffic while prioritizing critical traffic. The state of practice poses challenges since architects must precisely encode their (somewhat fuzzy) intent into formal optimization models using abstract notions such as utility functions, and ad hoc manually tuned knobs. In this paper, we present the first effort to synthesize network designs with indeterminate objectives using an interactive program synthesis based approach. We make three contributions. First, we present a novel framework in which a user's design objective, and the synthesis of a program (network design) that optimizes that objective are done in tandem. Second, we develop a novel algorithm for our framework in which a voting guided learner makes two kinds of queries (Propose and Compare) to the user, with the aim of minimizing the number of queries. We present theoretical analysis of the convergence rate of the algorithm. Third, we implemented Net10Q, a system based on our approach, and demonstrate its effectiveness on four real world network case studies using black box oracles and simulation experiments, as well as a pilot user study comprising network researchers and practitioners. Both theoretical and experimental results show the promise of our approach.


MBAPose Mask and Bounding Box Aware Pose Estimation of Surgical Instruments with Photorealistic Domain Randomization. Surgical robots are usually controlled using a priori models based on the robots' geometric parameters, which are calibrated before the surgical procedure. One of the challenges in using robots in real surgical settings is that those parameters can change over time, consequently deteriorating control accuracy. In this context, our group has been investigating online calibration strategies without added sensors. In one step toward that goal, we have developed an algorithm to estimate the pose of the instruments' shafts in endoscopic images. In this study, we build upon that earlier work and propose a new framework to more precisely estimate the pose of a rigid surgical instrument. Our strategy is based on a novel pose estimation model called MBAPose and the use of synthetic training data. Our experiments demonstrated an improvement of 21 for translation error and 26 for orientation error on synthetic test data with respect to our previous work. Results with real test data provide a baseline for further research.


An application of a moment problem to completely monotonic functions. We consider the following question if a function of the form int 0 infty varphi(t) , e xt dt is completely monotonic, is it then varphi ge0 ? It turns out that the question is related to a moment problem. In the end we apply those results to answer some questions concerning complete monotonicity of certain functions raised in F. Qi and R. Agarwal, textit On complete monotonicity for several classes of functions related to ratios of gamma functions , J. Inequal. Appl. (2019).


A multiple scattering formulation for finite size flexural metasurfaces. We provide an analytical formulation to model the propagation of elastic waves in a homogeneous half space supporting an array of thin plates. The technique provides the displacement field obtained from the interaction between an incident wave generated by a harmonic source and the scattered fields induced by the flexural motion of the plates. The scattered field generated by each plate is calculated using an ad hoc set of Green's functions. The interaction between the incident field and the scattered fields is modeled through a multiple scattering formulation. Owing to the introduction of the multiple scattering formalism, the proposed technique can handle a generic set of plates arbitrarily arranged on the half space surface. The method is validated via comparison with finite element simulations considering Rayleigh waves interacting with a single and a collection of thin plates. Our framework can be used to investigate the interaction of vertically polarized surface waves and flexural resonators in different engineering contexts, from the design of novel surface acoustic wave devices to the interpretation of urban vibrations problems.


SDEdit Guided Image Synthesis and Editing with Stochastic Differential Equations. Guided image synthesis enables everyday users to create and edit photo realistic images with minimum effort. The key challenge is balancing faithfulness to the user input (e.g., hand drawn colored strokes) and realism of the synthesized image. Existing GAN based methods attempt to achieve such balance using either conditional GANs or GAN inversions, which are challenging and often require additional training data or loss functions for individual applications. To address these issues, we introduce a new image synthesis and editing method, Stochastic Differential Editing (SDEdit), based on a diffusion model generative prior, which synthesizes realistic images by iteratively denoising through a stochastic differential equation (SDE). Given an input image with user guide of any type, SDEdit first adds noise to the input, then subsequently denoises the resulting image through the SDE prior to increase its realism. SDEdit does not require task specific training or inversions and can naturally achieve the balance between realism and faithfulness. SDEdit significantly outperforms state of the art GAN based methods by up to 98.09 on realism and 91.72 on overall satisfaction scores, according to a human perception study, on multiple tasks, including stroke based image synthesis and editing as well as image compositing.


Telecommunication wavelength two dimensional photonic crystal cavities in a thin single crystal diamond membrane. We demonstrate two dimensional photonic crystal cavities operating at telecommunication wavelengths in a single crystal diamond membrane. We use a high optical quality and thin ( 300 nm) diamond membrane, supported by a polycrystalline diamond frame, to realize fully suspended two dimensional photonic crystal cavities with a high theoretical quality factor of 8 times10 6 and a relatively small mode volume of 2 ( lambda n) 3 . The cavities are fabricated in the membrane using electron beam lithography and vertical dry etching. We observe cavity resonances over a wide wavelength range spanning the telecommunication O and S bands (1360 nm 1470 nm) with Q factors of up to 1800. Our method offers a new direction for on chip diamond nanophotonic applications in the telecommunication wavelength range.


Systolic inequalities for the number of vertices. Inspired by the classical Riemannian systolic inequality of Gromov we present a combinatorial analogue providing a lower bound on the number of vertices of a simplicial complex in terms of its edge path systole. Similarly to the Riemannian case, where the inequality holds under a topological assumption of "essentiality'', our proofs rely on a combinatorial analogue of that assumption. Under a stronger assumption, expressed in terms of cohomology cup length, we improve our results quantitatively. We also illustrate our methods in the continuous setting, generalizing and improving quantitatively the Minkowski principle of Balacheff and Karam a corollary of this result is the extension of the Guth Nakamura cup length systolic bound from manifolds to complexes.


Mechanical activity and odd elasticity of passive, 2D chiral metamaterials. We demonstrate a general route to making active, odd elastic solids from passive chiral elements that can act as sources of mechanical work by violating static equilibrium without internal sources of energy or momentum. We further demonstrate that by starting from a discrete, Newtonian mechanics viewpoint of the chiral unit cell, we can develop the continuum field equations for isotropic 2D chiral metamaterials that reveal odd elasticity, while elucidating the structure property relationships underpinning the chiral, elastic moduli that enable the mechanical activity of the chiral metamaterials. By demonstrating the energy gain of chiral metamaterials as they undergo quasistatic deformation cycles, we show a new route to designing active, non reciprocal mechanical metamaterials that can operate at zero frequency.


An Ontological Knowledge Representation for Smart Agriculture. In order to provide the agricultural industry with the infrastructure it needs to take advantage of advanced technology, such as big data, the cloud, and the internet of things (IoT) smart farming is a management concept that focuses on providing the infrastructure necessary to track, monitor, automate, and analyse operations. To represent the knowledge extracted from the primary data collected is of utmost importance. An agricultural ontology framework for smart agriculture systems is presented in this study. The knowledge graph is represented as a lattice to capture and perform reasoning on spatio temporal agricultural data.


A Weighted and Normalized Gould Fernandez Brokerage Measure. The Gould and Fernandez local brokerage measure defines brokering roles based on the group membership of the nodes from the incoming and outgoing edges. This paper extends on this brokerage measure to account for weighted edges and introduces the Weighted Normalized Gould Fernandez measure (WNGF). The measure is applied to the EUREGIO inter regional trade dataset and an information flow network in an R D group. The results gained from the WNGF measure are compared to those from two dichotomised networks a threshold and a multiscale backbone network. The results show that while the WNGF measure produces similar results to that of the dichotomised network it also ensures information retention a nuanced understanding of each node's brokerage role, without having to alter the structure of the original network.


Analytic Hochschild Kostant Rosenberg Theorem. Let R be a Banach ring. We prove that the category of chain complexes of complete bornological R modules (and several related categories) is a derived algebraic context in the sense of Raksit. We then use the framework of derived algebra to prove a version of the Hochschild Kostant Rosenberg Theorem, which relates the circle action on the Hochschild algebra to the de Rham differential enriched de Rham algebra of a simplicial, commutative, complete bornological algebra. This has a geometric interpretation in the language of derived analytic geometry, namely, the derived loop stack of a derived analytic stack is equivalent to the shifted tangent stack. Using this geometric interpretation we extend our results to derived schemes.


Tamizhi Net OCR Creating A Quality Large Scale Tamil Sinhala English Parallel Corpus Using Deep Learning Based Printed Character Recognition (PCR). Most of the low resource languages do not have the necessary resources to create even a substantial monolingual corpus. These languages may often be found in government proceedings but mainly in Portable Document Formats (PDFs) that contain legacy fonts. Extracting text from these documents to create a monolingual corpus is challenging due to legacy font usage and printer friendly encoding, which are not optimised for text extraction. Therefore, we propose a simple, automatic, and novel idea that can scale for Tamil, Sinhala, English languages and many documents. For this purpose, we enhanced the performance of Tesseract 4.1.1 by employing LSTM based training on many legacy fonts to recognise printed characters in the above languages. Especially, our model detects code mix text, numbers, and special characters from the printed document. It is shown that this approach can boost the character level accuracy of Tesseract 4.1.1 from 85.5 to 98.2 for Tamil ( 12.9 relative change) and 91.8 to 94.8 for Sinhala ( 3.26 relative change) on a dataset that is considered as challenging by its authors.


The lower bound on the HK multiplicities of quadric hypersurfaces. Here we prove that the Hilbert Kunz mulitiplicity of a quadric hypersurface of dimension d and odd characteristic p geq 2d 4 is bounded below by 1 m d , where m d is the d th coefficient in the expansion of mbox sec mbox tan . This proves a part of the long standing conjecture of Watanabe Yoshida. We also give an upper bound on the HK multiplicity of such a hypersurface. We approach the question using the HK density function and the classification of ACM bundles on the smooth quadrics via matrix factorizations.


Triviality of the geometry of mixed p spin spherical Hamiltonians with external field. We study isotropic Gaussian random fields on the high dimensional sphere with an added deterministic linear term, also known as mixed p spin Hamiltonians with external field. We prove that if the external field is sufficiently strong, then the resulting function has trivial geometry, that is only two critical points. This contrasts with the situation of no or weak external field where these functions typically have an exponential number of critical points. We give an explicit threshold h c for the magnitude of the external fieldnecessary for trivialization and conjecture h c to be sharp. The Kac Rice formula is our main tool. Our work extends Fyo15 , which identified the trivial regime for the special case of pure p spin Hamiltonians with random external field.


A Review of the Non Invasive Techniques for Monitoring Different Aspects of Sleep. Quality sleep is very important for a healthy life. Nowadays, many people around the world are not getting enough sleep which is having negative impacts on their lifestyles. Studies are being conducted for sleep monitoring and have now become an important tool for understanding sleep behavior. The gold standard method for sleep analysis is polysomnography (PSG) conducted in a clinical environment but this method is both expensive and complex for long term use. With the advancements in the field of sensors and the introduction of off the shelf technologies, unobtrusive solutions are becoming common as alternatives for in home sleep monitoring. Various solutions have been proposed using both wearable and non wearable methods which are cheap and easy to use for in home sleep monitoring. In this paper, we present a comprehensive survey of the latest research works (2015 and after) conducted in various categories of sleep monitoring including sleep stage classification, sleep posture recognition, sleep disorders detection, and vital signs monitoring. We review the latest works done using the non invasive approach and cover both wearable and non wearable methods. We discuss the design approaches and key attributes of the work presented and provide an extensive analysis based on 10 key factors, to give a comprehensive overview of the recent developments and trends in all four categories of sleep monitoring. We also present some publicly available datasets for different categories of sleep monitoring. In the end, we discuss several open issues and provide future research directions in the area of sleep monitoring.


DualPoseNet Category level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistency. Category level 6D object pose and size estimation is to predict full pose configurations of rotation, translation, and size for object instances observed in single, arbitrary views of cluttered scenes. In this paper, we propose a new method of Dual Pose Network with refined learning of pose consistency for this task, shortened as DualPoseNet. DualPoseNet stacks two parallel pose decoders on top of a shared pose encoder, where the implicit decoder predicts object poses with a working mechanism different from that of the explicit one they thus impose complementary supervision on the training of pose encoder. We construct the encoder based on spherical convolutions, and design a module of Spherical Fusion wherein for a better embedding of pose sensitive features from the appearance and shape observations. Given no testing CAD models, it is the novel introduction of the implicit decoder that enables the refined pose prediction during testing, by enforcing the predicted pose consistency between the two decoders using a self adaptive loss term. Thorough experiments on benchmarks of both category and instance level object pose datasets confirm efficacy of our designs. DualPoseNet outperforms existing methods with a large margin in the regime of high precision. Our code is released publicly at https github.com Gorilla Lab SCUT DualPoseNet.


Boosting Salient Object Detection with Transformer based Asymmetric Bilateral U Net. Existing salient object detection (SOD) methods mainly rely on CNN based U shaped structures with skip connections to combine the global contexts and local spatial details that are crucial for locating salient objects and refining object details, respectively. Despite great successes, the ability of CNN in learning global contexts is limited. Recently, the vision transformer has achieved revolutionary progress in computer vision owing to its powerful modeling of global dependencies. However, directly applying the transformer to SOD is suboptimal because the transformer lacks the ability to learn local spatial representations. To this end, this paper explores the combination of transformer and CNN to learn both global and local representations for SOD. We propose a transformer based Asymmetric Bilateral U Net (ABiU Net). The asymmetric bilateral encoder has a transformer path and a lightweight CNN path, where the two paths communicate at each encoder stage to learn complementary global contexts and local spatial details, respectively. The asymmetric bilateral decoder also consists of two paths to process features from the transformer and CNN encoder paths, with communication at each decoder stage for decoding coarse salient object locations and find grained object details, respectively. Such communication between the two encoder decoder paths enables AbiU Net to learn complementary global and local representations, taking advantage of the natural properties of transformer and CNN, respectively. Hence, ABiU Net provides a new perspective for transformer based SOD. Extensive experiments demonstrate that ABiU Net performs favorably against previous state of the art SOD methods. The code will be released.


Power Based Attacks on Spatial DNN Accelerators. With proliferation of DNN based applications, the confidentiality of DNN model is an important commercial goal. Spatial accelerators, that parallelize matrix vector operations, are utilized for enhancing energy efficiency of DNN computation. Recently, model extraction attacks on simple accelerators, either with a single processing element or running a binarized network, were demonstrated using the methodology derived from differential power analysis (DPA) attack on cryptographic devices. This paper investigates the vulnerability of realistic spatial accelerators using general, 8 bit, number representation. We investigate two systolic array architectures with weight stationary dataflow (1) a 3 times 1 array for a dot product operation, and (2) a 3 times 3 array for matrix vector multiplication. Both are implemented on the SAKURA G FPGA board. We show that both architectures are ultimately vulnerable. A conventional DPA succeeds fully on the 1D array, requiring 20K power measurements. However, the 2D array exhibits higher security even with 460K traces. We show that this is because the 2D array intrinsically entails multiple MACs simultaneously dependent on the same input. However, we find that a novel template based DPA with multiple profiling phases is able to fully break the 2D array with only 40K traces. Corresponding countermeasures need to be investigated for spatial DNN accelerators.


Additive arithmetic functions meet the inclusion exclusion principle. We obtain asymptotic formulas for the sums sum n 1, ldots,n k le x f((n 1, ldots,n k)) and sum n 1, ldots,n k le x f( n 1, ldots,n k ) involving the gcd and lcm of the integers n 1, ldots,n k , where f belongs to certain classes of additive arithmetic functions. In particular, we consider the generalized omega function Omega ell (n) sum p nu mid mid n nu ell investigated by Duncan (1962) and Hassani (2018), and the functions A(n) sum p nu mid mid n nu p , A (n) sum p mid n p , B(n) A(n) A (n) studied by Alladi and Erd H o s (1977). As a key auxiliary result we use an inclusion exclusion type identity.


physics.ao-ph cs.NA math.NA physics.flu-dyn

Parallel Exponential Time Differencing Methods for Geophysical Flow Simulations. Two ocean models are considered for geophysical flow simulations the multi layer shallow water equations and the multi layer primitive equations. For the former, we investigate the parallel performance of exponential time differencing (ETD) methods, including exponential Rosenbrock Euler, ETD2wave, and B ETD2wave. For the latter, we take advantage of the splitting of barotropic and baroclinic modes and propose a new two level method in which an ETD method is applied to solve the fast barotropic mode. These methods could improve the computational efficiency of numerical simulations because ETD methods allow for much larger time step sizes than traditional explicit time stepping techniques that are commonly used in existing computational ocean models. Several standard benchmark tests for ocean modeling are performed and comparison of the numerical results demonstrate a great potential of applying the parallel ETD methods for simulating real world geophysical flows.


Stage wise Fine tuning for Graph to Text Generation. Graph to text generation has benefited from pre trained language models (PLMs) in achieving better performance than structured graph encoders. However, they fail to fully utilize the structure information of the input graph. In this paper, we aim to further improve the performance of the pre trained language model by proposing a structured graph to text model with a two step fine tuning mechanism which first fine tunes the model on Wikipedia before adapting to the graph to text generation. In addition to using the traditional token and position embeddings to encode the knowledge graph (KG), we propose a novel tree level embedding method to capture the inter dependency structures of the input graph. This new approach has significantly improved the performance of all text generation metrics for the English WebNLG 2017 dataset.


The Multiscale Perturbation Method for Two Phase Reservoir Flow Problems. In this work we formulate and test a new procedure, the Multiscale Perturbation Method for Two Phase Flows (MPM 2P), for the fast, accurate and naturally parallelizable numerical solution of two phase, incompressible, immiscible displacement in porous media approximated by an operator splitting method. The proposed procedure is based on domain decomposition and combines the Multiscale Perturbation Method (MPM) with the Multiscale Robin Coupled Method (MRCM). When an update of the velocity field is called by the operator splitting algorithm, the MPM 2P may provide, depending on the magnitude of a dimensionless algorithmic parameter, an accurate and computationally inexpensive approximation for the velocity field by reusing previously computed multiscale basis functions. Thus, a full update of all multiscale basis functions required by the MRCM for the construction of a new velocity field is avoided. There are two main steps in the formulation of the MPM 2P. Initially, for each subdomain one local boundary value problem with trivial Robin boundary conditions is solved (instead of a full set of multiscale basis functions, that would be required by the MRCM). Then, the solution of an inexpensive interface problem provides the velocity field on the skeleton of the decomposition of the domain. The resulting approximation for the velocity field is obtained by downscaling. We consider challenging two phase flow problems, with high contrast permeability fields and water oil finger growth in homogeneous media. Our numerical experiments show that the use of the MPM 2P gives exceptional speed up almost 90 of reduction in computational cost of two phase flow simulations. Hundreds of MRCM solutions can be replaced by inexpensive MPM 2P solutions, and water breakthrough can be simulated with very few updates of the MRCM set of multiscale basis functions.


The Typical Non Linear Code over Large Alphabets. We consider the problem of describing the typical (possibly) non linear code of minimum distance bounded from below over a large alphabet. We concentrate on block codes with the Hamming metric and on subspace codes with the injection metric. In sharp contrast with the behavior of linear block codes, we show that the typical non linear code in the Hamming metric of cardinality q n d 1 is far from having minimum distance d , i.e., from being MDS. We also give more precise results about the asymptotic proportion of block codes with good distance properties within the set of codes having a certain cardinality. We then establish the analogous results for subspace codes with the injection metric, showing also an application to the theory of partial spreads in finite geometry.


Adapting ImageNet scale models to complex distribution shifts with self learning. While self learning methods are an important component in many recent domain adaptation techniques, they are not yet comprehensively evaluated on ImageNet scale datasets common in robustness research. In extensive experiments on ResNet and EfficientNet models, we find that three components are crucial for increasing performance with self learning (i) using short update times between the teacher and the student network, (ii) fine tuning only few affine parameters distributed across the network, and (iii) leveraging methods from robust classification to counteract the effect of label noise. We use these insights to obtain drastically improved state of the art results on ImageNet C (22.0 mCE), ImageNet R (17.4 error) and ImageNet A (14.8 error). Our techniques yield further improvements in combination with previously proposed robustification methods. Self learning is able to reduce the top 1 error to a point where no substantial further progress can be expected. We therefore re purpose the dataset from the Visual Domain Adaptation Challenge 2019 and use a subset of it as a new robustness benchmark (ImageNet D) which proves to be a more challenging dataset for all current state of the art models (58.2 error) to guide future research efforts at the intersection of robustness and domain adaptation on ImageNet scale.


Rethinking Content and Style Exploring Bias for Unsupervised Disentanglement. Content and style (C S) disentanglement intends to decompose the underlying explanatory factors of objects into two independent subspaces. From the unsupervised disentanglement perspective, we rethink content and style and propose a formulation for unsupervised C S disentanglement based on our assumption that different factors are of different importance and popularity for image reconstruction, which serves as a data bias. The corresponding model inductive bias is introduced by our proposed C S disentanglement Module (C S DisMo), which assigns different and independent roles to content and style when approximating the real data distributions. Specifically, each content embedding from the dataset, which encodes the most dominant factors for image reconstruction, is assumed to be sampled from a shared distribution across the dataset. The style embedding for a particular image, encoding the remaining factors, is used to customize the shared distribution through an affine transformation. The experiments on several popular datasets demonstrate that our method achieves the state of the art unsupervised C S disentanglement, which is comparable or even better than supervised methods. We verify the effectiveness of our method by downstream tasks domain translation and single view 3D reconstruction. Project page at https github.com xrenaa CS DisMo.


Light confinement by local index tailoring in inhomogeneous dielectrics. The engineering of light confinement is a topic with a long history in optics and with significant implications for the control of light matter interaction. In inhomogeneous and disordered media, however, multiple scattering prevents the application of conventional approaches for the design of light fields with desired properties. This is because any local change to such a medium typically affects these fields in a non local and complicated fashion. Here, we present a theoretical methodology for tailoring an inhomogeneous one dimensional (1D) Hermitian dielectric index distribution, such that the intensity profile of an incoming light field can be controlled purely locally, i.e., with little or no influence on the field profile outside of a designated region of interest. Strongly increasing or decreasing the light's intensity at arbitrary positions inside the medium thereby becomes possible without, in fact, changing the external reflectance or transmittance of the medium. These local modifications of the medium can thus be made undetectable to unidirectional far field measurements. We apply our approach to locally control the confinement of light inside 1D materials with inhomogeneous continuous refractive index profiles and extend it to multilayer films as well as to chains of coupled micro resonators.


SPRISS Approximating Frequent k mers by Sampling Reads, and Applications. The extraction of k mers is a fundamental component in many complex analyses of large next generation sequencing datasets, including reads classification in genomics and the characterization of RNA seq datasets. The extraction of all k mers and their frequencies is extremely demanding in terms of running time and memory, owing to the size of the data and to the exponential number of k mers to be considered. However, in several applications, only frequent k mers, which are k mers appearing in a relatively high proportion of the data, are required by the analysis. In this work we present SPRISS, a new efficient algorithm to approximate frequent k mers and their frequencies in next generation sequencing data. SPRISS employs a simple yet powerful reads sampling scheme, which allows to extract a representative subset of the dataset that can be used, in combination with any k mer counting algorithm, to perform downstream analyses in a fraction of the time required by the analysis of the whole data, while obtaining comparable answers. Our extensive experimental evaluation demonstrates the efficiency and accuracy of SPRISS in approximating frequent k mers, and shows that it can be used in various scenarios, such as the comparison of metagenomic datasets and the identification of discriminative k mers, to extract insights in a fraction of the time required by the analysis of the whole dataset.


Averaged mixed Julia Fatou type theory with applications to spectral foliation. Classically, theorems of Fatou and Julia describe the boundary regularity of functions in one complex variable. The former says that a complex analytic function on the disk has non tangential boundary values almost everywhere, and the latter describes when a function takes an extreme value at a boundary point and is differentiable there non tangentially. We describe a class of intermediate theorems in terms of averaged Julia Fatou quotients. Boundary regularity is related to integrability of certain quantities against a special measure, the so called Nevanlinna measure. Applications are given to spectral theory.


Deep Convolution for Irregularly Sampled Temporal Point Clouds. We consider the problem of modeling the dynamics of continuous spatial temporal processes represented by irregular samples through both space and time. Such processes occur in sensor networks, citizen science, multi robot systems, and many others. We propose a new deep model that is able to directly learn and predict over this irregularly sampled data, without voxelization, by leveraging a recent convolutional architecture for static point clouds. The model also easily incorporates the notion of multiple entities in the process. In particular, the model can flexibly answer prediction queries about arbitrary space time points for different entities regardless of the distribution of the training or test time data. We present experiments on real world weather station data and battles between large armies in StarCraft II. The results demonstrate the model's flexibility in answering a variety of query types and demonstrate improved performance and efficiency compared to state of the art baselines.


Scientific multi agent reinforcement learning for wall models of turbulent flows. The predictive capabilities of turbulent flow simulations, critical for aerodynamic design and weather prediction, hinge on the choice of turbulence models. The abundance of data from experiments and simulations and the advent of machine learning have provided a boost to turbulence modeling efforts. However, simulations of turbulent flows remain hindered by the inability of heuristics and supervised learning to model the near wall dynamics. We address this challenge by introducing scientific multi agent reinforcement learning (SciMARL) for the discovery of wall models for large eddy simulations (LES). In SciMARL, discretization points act also as cooperating agents that learn to supply the LES closure model. The agents self learn using limited data and generalize to extreme Reynolds numbers and previously unseen geometries. The present simulations reduce by several orders of magnitude the computational cost over fully resolved simulations while reproducing key flow quantities. We believe that SciMARL creates unprecedented capabilities for the simulation of turbulent flows.


Quotients of Severi Brauer surfaces. We show that a quotient of a non trivial Severi Brauer surface S over arbitrary field Bbbk of characteristic 0 by a finite group G subset operatorname Aut (S) is Bbbk rational, if and only if G is divisible by 3 . Otherwise, the quotient is birationally equivalent to S .


Time resolved quantum beats in the fluorescence of helium resonantly excited by XUV radiation. We report on the observation of time resolved quantum beats in the helium fluorescence from the transition 1s3p 1s2s, where the initial state is excited by XUV free electron laser radiation. The quantum beats originate from the Zeeman splitting of the magnetic substates due to an external magnetic field. We perform a systematic study of this effect and discuss the possibilities of studying this phenomenon in the XUV and x ray regime.


Simple Recurrent Neural Networks is all we need for clinical events predictions using EHR data. Recently, there is great interest to investigate the application of deep learning models for the prediction of clinical events using electronic health records (EHR) data. In EHR data, a patient's history is often represented as a sequence of visits, and each visit contains multiple events. As a result, deep learning models developed for sequence modeling, like recurrent neural networks (RNNs) are common architecture for EHR based clinical events predictive models. While a large variety of RNN models were proposed in the literature, it is unclear if complex architecture innovations will offer superior predictive performance. In order to move this field forward, a rigorous evaluation of various methods is needed. In this study, we conducted a thorough benchmark of RNN architectures in modeling EHR data. We used two prediction tasks the risk for developing heart failure and the risk of early readmission for inpatient hospitalization. We found that simple gated RNN models, including GRUs and LSTMs, often offer competitive results when properly tuned with Bayesian Optimization, which is in line with similar to findings in the natural language processing (NLP) domain. For reproducibility, Our codebase is shared at https github.com ZhiGroup pytorch ehr.


Routing with Self Attention for Multimodal Capsule Networks. The task of multimodal learning has seen a growing interest recently as it allows for training neural architectures based on different modalities such as vision, text, and audio. One challenge in training such models is that they need to jointly learn semantic concepts and their relationships across different input representations. Capsule networks have been shown to perform well in context of capturing the relation between low level input features and higher level concepts. However, capsules have so far mainly been used only in small scale fully supervised settings due to the resource demand of conventional routing algorithms. We present a new multimodal capsule network that allows us to leverage the strength of capsules in the context of a multimodal learning framework on large amounts of video data. To adapt the capsules to large scale input data, we propose a novel routing by self attention mechanism that selects relevant capsules which are then used to generate a final joint multimodal feature representation. This allows not only for robust training with noisy video data, but also to scale up the size of the capsule network compared to traditional routing methods while still being computationally efficient. We evaluate the proposed architecture by pretraining it on a large scale multimodal video dataset and applying it on four datasets in two challenging downstream tasks. Results show that the proposed multimodal capsule network is not only able to improve results compared to other routing techniques, but also achieves competitive performance on the task of multimodal learning.


Performing Creativity With Computational Tools. The introduction of new tools in people's workflow has always been promotive of new creative paths. This paper discusses the impact of using computational tools in the performance of creative tasks, especially focusing on graphic design. The study was driven by a grounded theory methodology, applied to a set of semi structured interviews, made to twelve people working in the areas of graphic design, data science, computer art, music and data visualisation. Among other questions, the results suggest some scenarios in which it is or it is not worth investing in the development of new intelligent creativity aiding tools.


A flow based IDS using Machine Learning in eBPF. eBPF is a new technology which allows dynamically loading pieces of code into the Linux kernel. It can greatly speed up networking since it enables the kernel to process certain packets without the involvement of a userspace program. So far eBPF has been used for simple packet filtering applications such as firewalls or Denial of Service protection. We show that it is possible to develop a flow based network intrusion detection system based on machine learning entirely in eBPF. Our solution uses a decision tree and decides for each packet whether it is malicious or not, considering the entire previous context of the network flow. We achieve a performance increase of over 20 compared to the same solution implemented as a userspace program.


Systemic formalisation of Cyber Physical Social System (CPSS) A systematic literature review. The notion of Cyber Physical Social System (CPSS) is an emerging concept developed as a result of the need to understand the impact of Cyber Physical Systems (CPS) on humans and vice versa. This paradigm shift from CPS to CPSS was mainly attributed to the increasing use of sensor enabled smart devices and the tight link with the users. The concept of CPSS has been around for over a decade and it has gained increasing attention over the past few years. The evolution to incorporate human aspects in the CPS research has unlocked a number of research challenges. Particularly human dynamics brings additional complexity that is yet to be explored. The exploration to conceptualise the notion of CPSS has been partially addressed in few scientific literatures. Although its conceptualisation has always been use case dependent. Thus, there is a lack of generic view as most works focus on specific domains. Furthermore, the systemic core and design principles linking it with the theory of systems are loose. This work aims at addressing these issues by first exploring and analysing scientific literature to understand the complete spectrum of CPSS through a Systematic Literature Review (SLR). Thereby identifying the state of the art perspectives on CPSS regarding definitions, underlining principles and application areas. Subsequently, based on the findings of the SLR, we propose a domain independent definition and a meta model for CPSS, grounded in the Theory of Systems. Finally, a discussion on feasible future research directions is presented based on the systemic notion and the proposed meta models.


Coalesced Multi Output Tsetlin Machines with Clause Sharing. Using finite state machines to learn patterns, Tsetlin machines (TMs) have obtained competitive accuracy and learning speed across several benchmarks, with frugal memory and energy footprint. A TM represents patterns as conjunctive clauses in propositional logic (AND rules), each clause voting for or against a particular output. While efficient for single output problems, one needs a separate TM per output for multi output problems. Employing multiple TMs hinders pattern reuse because each TM then operates in a silo. In this paper, we introduce clause sharing, merging multiple TMs into a single one. Each clause is related to each output by using a weight. A positive weight makes the clause vote for output 1 , while a negative weight makes the clause vote for output 0 . The clauses thus coalesce to produce multiple outputs. The resulting coalesced Tsetlin Machine (CoTM) simultaneously learns both the weights and the composition of each clause by employing interacting Stochastic Searching on the Line (SSL) and Tsetlin Automata (TA) teams. Our empirical results on MNIST, Fashion MNIST, and Kuzushiji MNIST show that CoTM obtains significantly higher accuracy than TM on 50 to 1 K clause configurations, indicating an ability to repurpose clauses. E.g., accuracy goes from 71.99 to 89.66 on Fashion MNIST when employing 50 clauses per class (22 Kb memory). While TM and CoTM accuracy is similar when using more than 1 K clauses per class, CoTM reaches peak accuracy 3 times faster on MNIST with 8 K clauses. We further investigate robustness towards imbalanced training data. Our evaluations on imbalanced versions of IMDb and CIFAR10 data show that CoTM is robust towards high degrees of class imbalance. Being able to share clauses, we believe CoTM will enable new TM application domains that involve multiple outputs, such as learning language models and auto encoding.


Efficient decision tree training with new data structure for secure multi party computation. We propose a secure multi party computation (MPC) protocol that constructs a secret shared decision tree for a given secret shared dataset. The previous MPC based decision tree training protocol (Abspoel et al. 2021) requires O(2 hmn log n) comparisons, being exponential in the tree height h and with n and m being the number of rows and that of attributes in the dataset, respectively. The cause of the exponential number of comparisons in h is that the decision tree training algorithm is based on the divide and conquer paradigm, where dummy rows are added after each split in order to hide the number of rows in the dataset. We resolve this issue via secure data structure that enables us to compute an aggregate value for every group while hiding the grouping information. By using this data structure, we can train a decision tree without adding dummy rows while hiding the size of the intermediate data. We specifically describes a decision tree training protocol that requires only O(hmn log n) comparisons when the input attributes are continuous and the output attribute is binary. Note that the order is now emph linear in the tree height h . To demonstrate the practicality of our protocol, we implement it in an MPC framework based on a three party secret sharing scheme. Our implementation results show that our protocol trains a decision tree with a height of 5 in 33 seconds for a dataset of 100,000 rows and 10 attributes.


Recent Advances in Video Question Answering A Review of Datasets and Methods. Video Question Answering (VQA) is a recent emerging challenging task in the field of Computer Vision. Several visual information retrieval techniques like Video Captioning Description and Video guided Machine Translation have preceded the task of VQA. VQA helps to retrieve temporal and spatial information from the video scenes and interpret it. In this survey, we review a number of methods and datasets for the task of VQA. To the best of our knowledge, no previous survey has been conducted for the VQA task.


MG GCN Scalable Multi GPU GCN Training Framework. Full batch training of Graph Convolutional Network (GCN) models is not feasible on a single GPU for large graphs containing tens of millions of vertices or more. Recent work has shown that, for the graphs used in the machine learning community, communication becomes a bottleneck and scaling is blocked outside of the single machine regime. Thus, we propose MG GCN, a multi GPU GCN training framework taking advantage of the high speed communication links between the GPUs present in multi GPU systems. MG GCN employs multiple High Performance Computing optimizations, including efficient re use of memory buffers to reduce the memory footprint of training GNN models, as well as communication and computation overlap. These optimizations enable execution on larger datasets, that generally do not fit into memory of a single GPU in state of the art implementations. Furthermore, they contribute to achieve superior speedup compared to the state of the art. For example, MG GCN achieves super linear speedup with respect to DGL, on the Reddit graph on both DGX 1 (V100) and DGX A100.


Faulty picture hanging improved. A picture hanging puzzle is the task of hanging a framed picture with a wire around a set of nails in such a way that it can remain hanging on certain specified sets of nails, but will fall if any more are removed. The classical brain teaser asks us to hang a picture on two nails in such a way that it falls when any one is detached. Demaine et al (2012) proved that all reasonable puzzles of this kind are solvable, and that for the k out of n problem, the size of a solution can be bounded by a polynomial in n . We give simplified proofs of these facts, for the latter leading to a reasonable exponent in the polynomial bound.


On the Impact of Spurious Correlation for Out of distribution Detection. Modern neural networks can assign high confidence to inputs drawn from outside the training distribution, posing threats to models in real world deployments. While much research attention has been placed on designing new out of distribution (OOD) detection methods, the precise definition of OOD is often left in vagueness and falls short of the desired notion of OOD in reality. In this paper, we present a new formalization and model the data shifts by taking into account both the invariant and environmental (spurious) features. Under such formalization, we systematically investigate how spurious correlation in the training set impacts OOD detection. Our results suggest that the detection performance is severely worsened when the correlation between spurious features and labels is increased in the training set. We further show insights on detection methods that are more effective in reducing the impact of spurious correlation and provide theoretical analysis on why reliance on environmental features leads to high OOD detection error. Our work aims to facilitate a better understanding of OOD samples and their formalization, as well as the exploration of methods that enhance OOD detection.


On the Complexity of the K way Vertex Cut Problem. The K way vertex cut problem consists in, given a graph G, finding a subset of vertices of a given size, whose removal partitions G into the maximum number of connected components. This problem has many applications in several areas. It has been proven to be NP complete on general graphs, as well as on split and planar graphs. In this paper, we enrich its complexity study with two new results. First, we prove that it remains NP complete even when restricted on the class of bipartite graphs. This is unlike what it is expected, given that the K way vertex cut problem is a generalization of the Maximum Independent set problem which is polynomially solvable on bipartite graphs. We also provide its equivalence to the wellknown problem, namely the Critical Node Problem (CNP), On split graphs. Therefore, any solving algorithm for the CNP on split graphs is a solving algorithm for the K way vertex cut problem and vice versa.


Improving Neural Machine Translation by Bidirectional Training. We present a simple and effective pretraining strategy bidirectional training (BiT) for neural machine translation. Specifically, we bidirectionally update the model parameters at the early stage and then tune the model normally. To achieve bidirectional updating, we simply reconstruct the training samples from "src rightarrow tgt" to "src tgt rightarrow tgt src" without any complicated model modifications. Notably, our approach does not increase any parameters or training steps, requiring the parallel data merely. Experimental results show that BiT pushes the SOTA neural machine translation performance across 15 translation tasks on 8 language pairs (data sizes range from 160K to 38M) significantly higher. Encouragingly, our proposed model can complement existing data manipulation strategies, i.e. back translation, data distillation, and data diversification. Extensive analyses show that our approach functions as a novel bilingual code switcher, obtaining better bilingual alignment.


Isolating Cuts, (Bi )Submodularity, and Faster Algorithms for Global Connectivity Problems. Li and Panigrahi, in recent work, obtained the first deterministic algorithm for the global minimum cut of a weighted undirected graph that runs in time o(mn) . They introduced an elegant and powerful technique to find isolating cuts for a terminal set in a graph via a small number of s t minimum cut computations. In this paper we generalize their isolating cut approach to the abstract setting of symmetric bisubmodular functions (which also capture symmetric submodular functions). Our generalization to bisubmodularity is motivated by applications to element connectivity and vertex connectivity. Utilizing the general framework and other ideas we obtain significantly faster randomized algorithms for computing global (and subset) connectivity in a number of settings including hypergraphs, element connectivity and vertex connectivity in graphs, and for symmetric submodular functions.


Trust but Verify Cryptographic Data Privacy for Mobility Management. The era of Big Data has brought with it a richer understanding of user behavior through massive data sets, which can help organizations optimize the quality of their services. In the context of transportation research, mobility data can provide Municipal Authorities (MA) with insights on how to operate, regulate, or improve the transportation network. Mobility data, however, may contain sensitive information about end users and trade secrets of Mobility Providers (MP). Due to this data privacy concern, MPs may be reluctant to contribute their datasets to MA. Using ideas from cryptography, we propose an interactive protocol between a MA and a MP in which MA obtains insights from mobility data without MP having to reveal its trade secrets or sensitive data of its users. This is accomplished in two steps a commitment step, and a computation step. In the first step, Merkle commitments and aggregated traffic measurements are used to generate a cryptographic commitment. In the second step, MP extracts insights from the data and sends them to MA. Using the commitment and zero knowledge proofs, MA can certify that the information received from MP is accurate, without needing to directly inspect the mobility data. We also present a differentially private version of the protocol that is suitable for the large query regime. The protocol is verifiable for both MA and MP in the sense that dishonesty from one party can be detected by the other. The protocol can be readily extended to the more general setting with multiple MPs via secure multi party computation.


Bosonic Random Walk Networks for Graph Learning. The development of Graph Neural Networks (GNNs) has led to great progress in machine learning on graph structured data. These networks operate via diffusing information across the graph nodes while capturing the structure of the graph. Recently there has also seen tremendous progress in quantum computing techniques. In this work, we explore applications of multi particle quantum walks on diffusing information across graphs. Our model is based on learning the operators that govern the dynamics of quantum random walkers on graphs. We demonstrate the effectiveness of our method on classification and regression tasks.