Projective Limits and Ultraproducts of Nonabelian Finite Groups. Groups that can be approximated by finite groups have been the center of much research. This has led to the investigations of the subgroups of metric ultraproducts of finite groups. This paper attempts to study the dual problem what are the quotients of ultraproducts of finite groups? Since an ultraproduct is an abstract quotient of the direct product, this also led to a more general question what are the abstract quotients of profinite groups? Certain cases were already well studied. For example, if we have a pro solvable group, then it is well known that any finite abstract quotients are still solvable. This paper studies the case of profinite groups from a surjective inverse system of non solvable finite groups. We shall show that, for various classes of groups mathcal C , any finite abstract quotient of a pro mathcal C group is still in mathcal C . Here mathcal C can be the class of finite semisimple groups, or the class of central products of quasisimple groups, or the class of products of finite almost simple groups and finite solvable groups, or the class of finite perfect groups with bounded commutator width. Furthermore, in the case of finite perfect groups with unbounded commutator width, we show that this is NOT the case. In fact, any finite group could be a quotient of an ultraproduct of finite perfect groups. We provide an explicit construction on how to achieve this for each finite group.


A Systematic Review on Hermite Hadamard Inequality Theory and Applications. Inequalities play important roles not only in mathematics, but also in other fields, such as economics and engineering. Even though many results are published on Hermite Hadamard (H H) type inequalities, new researcher to this fields often found it difficult to understand them. Thus, some important discoverers, such as the formulations of H H type inequalities via various classes of convexity, through differentiable mappings and for fractional integrals, are presented. Some well known examples from previous literature are used as illustrations.


On the value distribution of iterated integrals of the logarithm of the Riemann zeta function II probabilistic aspects. In this paper, we discuss the value distribution of the Riemann zeta function. The authors give some results for the discrepancy estimate and large deviations in the limit theorem by Bohr and Jessen.


Evolving Evaluation Functions for Collectible Card Game AI. In this work, we presented a study regarding two important aspects of evolving feature based game evaluation functions the choice of genome representation and the choice of opponent used to test the model. We compared three representations. One simpler and more limited, based on a vector of weights that are used in a linear combination of predefined game features. And two more complex, based on binary and n ary trees. On top of this test, we also investigated the influence of fitness defined as a simulation based function that plays against a fixed weak opponent, plays against a fixed strong opponent, and plays against the best individual from the previous population. For a testbed, we have chosen a recently popular domain of digital collectible card games. We encoded our experiments in a programming game, Legends of Code and Magic, used in Strategy Card Game AI Competition. However, as the problems stated are of general nature we are convinced that our observations are applicable in the other domains as well.


DACBench A Benchmark Library for Dynamic Algorithm Configuration. Dynamic Algorithm Configuration (DAC) aims to dynamically control a target algorithm's hyperparameters in order to improve its performance. Several theoretical and empirical results have demonstrated the benefits of dynamically controlling hyperparameters in domains like evolutionary computation, AI Planning or deep learning. Replicating these results, as well as studying new methods for DAC, however, is difficult since existing benchmarks are often specialized and incompatible with the same interfaces. To facilitate benchmarking and thus research on DAC, we propose DACBench, a benchmark library that seeks to collect and standardize existing DAC benchmarks from different AI domains, as well as provide a template for new ones. For the design of DACBench, we focused on important desiderata, such as (i) flexibility, (ii) reproducibility, (iii) extensibility and (iv) automatic documentation and visualization. To show the potential, broad applicability and challenges of DAC, we explore how a set of six initial benchmarks compare in several dimensions of difficulty.


Computing the one parameter Nielsen number for homotopies on n torus. Let F T n times I to T n be a homotopy on a n dimensional torus. The main purpose of this paper is to present a formula for the one parameter Nielsen number N(F) of F in terms of induced homomorphism. If L(F) is the one parameter Lefschetz class of F then L(F) is given by L(F) pm N(F) alpha, for some alpha in H 1 ( pi 1 (T n ), mathbb Z ).


Simple Uncoupled No Regret Learning Dynamics for Extensive Form Correlated Equilibrium. The existence of simple uncoupled no regret learning dynamics that converge to correlated equilibria in normal form games is a celebrated result in the theory of multi agent systems. Specifically, it has been known for more than 20 years that when all players seek to minimize their internal regret in a repeated normal form game, the empirical frequency of play converges to a normal form correlated equilibrium. Extensive form games generalize normal form games by modeling both sequential and simultaneous moves, as well as imperfect information. Because of the sequential nature and presence of private information in the game, correlation in extensive form games possesses significantly different properties than its counterpart in normal form games, many of which are still open research directions. Extensive form correlated equilibrium (EFCE) has been proposed as the natural extensive form counterpart to the classical notion of correlated equilibrium in normal form games. Compared to the latter, the constraints that define the set of EFCEs are significantly more complex, as the correlation device must keep into account the evolution of beliefs of each player as they make observations throughout the game. Due to that significant added complexity, the existence of uncoupled learning dynamics leading to an EFCE has remained a challenging open research question for a long time. In this article, we settle that question by giving the first uncoupled no regret dynamics that converge to the set of EFCEs in n player general sum extensive form games with perfect recall. We show that each iterate can be computed in time polynomial in the size of the game tree, and that, when all players play repeatedly according to our learning dynamics, the empirical frequency of play is proven to be a O(T 0.5) approximate EFCE with high probability after T game repetitions, and an EFCE almost surely in the limit.


iSegFormer Interactive Segmentation via Transformers with Application to 3D Knee MR Images. We propose iSegFormer, a memory efficient transformer that combines a Swin transformer with a lightweight multilayer perceptron (MLP) decoder. With the efficient Swin transformer blocks for hierarchical self attention and the simple MLP decoder for aggregating both local and global attention, iSegFormer learns powerful representations while achieving high computational efficiencies. Specifically, we apply iSegFormer to interactive 3D medical image segmentation.


Finite rate chemistry effects in turbulent hypersonic boundary layers a direct numerical simulation study. The influence of high enthalpy effects on hypersonic turbulent boundary layers is investigated by means of direct numerical simulations (DNS). A quasi adiabatic flat plate air flow at free stream Mach number equal to 10 is simulated up to fully developed turbulent conditions using a five species, chemically reacting model. A companion DNS based on a frozen chemistry assumption is also carried out, in order to isolate the effect of finite rate chemical reactions and assess their influence on turbulent quantities. In order to reduce uncertainties associated with turbulence generation at the inlet of the computational domain, both simulations are initiated in the laminar flow region and the flow is let to evolve up to the fully turbulent regime. Modal forcing by means of localized suction and blowing is used to trigger laminar to turbulent transition. The high temperatures reached in the near wall region including the viscous and buffer sublayers activate significant dissociation of both oxygen and nitrogen. This modifies in turn the thermodynamic and transport properties of the reacting mixture, affecting the first order statistics of thermodynamic quantities. Due to the endothermic nature of the chemical reactions in the forward direction, temperature and density fluctuations in the reacting layer are smaller than in the frozen chemistry flow. However, the first and second order statistics of the velocity field are found to be little affected by the chemical reactions under a scaling that accounts for the modified fluid properties. We also observed that the Strong Reynolds Analogy (SRA) remains well respected despite the severe hypersonic conditions and that the computed skin friction coefficient distributions match well the results of the Renard Deck decomposition extended to compressible flows.


A note on stability of Eliasson Kuksin's KAM tori for the nonlinear Schr " o dinger equation. Eliasson and Kuksin developed a KAM approach to study the persistence of the invariant tori for nonlinear Schr " o dinger equation on mathbb T d . In this note, we improve Eliasson and Kuksin's KAM theorem by using Kolmogorov's iterative scheme and obtain a local normal form for the transformed Hamiltonian. As a consequence, we are able to derive the time delta 1 stability of the obtained KAM tori.


Trust Me If You Can Trusted Transformation Between (JSON) Schemas to Support Global Authentication of Education Credentials. Recruiters and institutions around the world struggle with the verification of diplomas issued in a diverse and global education setting. Firstly, it is a nontrivial problem to identify bogus institutions selling education credentials. While institutions are often accredited by qualified authorities on a regional level, there is no global authority fulfilling this task. Secondly, many different data schemas are used to encode education credentials, which represents a considerable challenge to automated processing. Consequently, significant manual effort is required to verify credentials. In this paper, we tackle these challenges by introducing a decentralized and open system to automatically verify the legitimacy of issuers and interpret credentials in unknown schemas. We do so by enabling participants to publish transformation information, which enables verifiers to transform credentials into their preferred schema. Due to the lack of a global root of trust, we utilize a distributed ledger to build a decentralized web of trust, which verifiers can query to gather information on the trustworthiness of issuing institutions and to establish trust in transformation information. Going beyond diploma fraud, our system can be generalized to tackle the generalized problem for other domains lacking a root of trust and agreements on data schemas.


Mobile authentication of copy detection patterns how critical is to know fakes?. Protection of physical objects against counterfeiting is an important task for the modern economies. In recent years, the high quality counterfeits appear to be closer to originals thanks to the rapid advancement of digital technologies. To combat these counterfeits, an anti counterfeiting technology based on hand crafted randomness implemented in a form of copy detection patterns (CDP) is proposed enabling a link between the physical and digital worlds and being used in various brand protection applications. The modern mobile phone technologies make the verification process of CDP easier and available to the end customers. Besides a big interest and attractiveness, the CDP authentication based on the mobile phone imaging remains insufficiently studied. In this respect, in this paper we aim at investigating the CDP authentication under the real life conditions with the codes printed on an industrial printer and enrolled via a modern mobile phone under the regular light conditions. The authentication aspects of the obtained CDP are investigated with respect to the four types of copy fakes. The impact of fakes' type used for training of authentication classifier is studied in two scenarios (i) supervised binary classification under various assumptions about the fakes and (ii) one class classification under unknown fakes. The obtained results show that the modern machine learning approaches and the technical capacity of modern mobile phones allow to make the CDP authentication under unknown fakes feasible with respect to the considered types of fakes and code design.


The Price of Selfishness Conjunctive Query Entailment for ALCSelf is 2ExpTime hard. In logic based knowledge representation, query answering has essentially replaced mere satisfiability checking as the inferencing problem of primary interest. For knowledge bases in the basic description logic ALC, the computational complexity of conjunctive query (CQ) answering is well known to be ExpTime complete and hence not harder than satisfiability. This does not change when the logic is extended by certain features (such as counting or role hierarchies), whereas adding others (inverses, nominals or transitivity together with role hierarchies) turns CQ answering exponentially harder. We contribute to this line of results by showing the surprising fact that even extending ALC by just the Self operator which proved innocuous in many other contexts increases the complexity of CQ entailment to 2ExpTime. As common for this type of problem, our proof establishes a reduction from alternating Turing machines running in exponential space, but several novel ideas and encoding tricks are required to make the approach work in that specific, restricted setting.


Contemporary Research Trends in Response Robotics. The multidisciplinary nature of response robotics has brought about a diversified research community with extended expertise. Motivated by the recent accelerated rate of publications in the field, this paper analyzes the technical content, statistics, and implications of the literature from bibliometric standpoints. The aim is to study the global progress of response robotics research and identify the contemporary trends. To that end, we investigated the collaboration mapping together with the citation network to formally recognize impactful and contributing authors, publications, sources, institutions, funding agencies, and countries. We found how natural and human made disasters contributed to forming productive regional research communities, while there are communities that only view response robotics as an application of their research. Furthermore, through an extensive discussion on the bibliometric results, we elucidated the philosophy behind research priority shifts in response robotics and presented our deliberations on future research directions.


Moment fitted cut spectral elements for explicit analysis of guided wave propagation. In this work, a method for the simulation of guided wave propagation in solids defined by implicit surfaces is presented. The method employs structured grids of spectral elements in combination to a fictitious domain approach to represent complex geometrical features through singed distance functions. A novel approach, based on moment fitting, is introduced to restore the diagonal mass matrix property in elements intersected by interfaces, thus enabling the use of explicit time integrators. Since this approach can lead to significantly decreased critical time steps for intersected elements, a "leap frog" algorithm is employed to locally comply with this condition, thus introducing only a small computational overhead. The resulting method is tested through a series of numerical examples of increasing complexity, where it is shown that it offers increased accuracy compared to other similar approaches. Due to these improvements, components of interest for SHM related tasks can be effectively discretized, while maintaining a performance comparable or only slightly worse than the standard spectral element method.


Exploring Transfer Learning on Face Recognition of Dark Skinned, Low Quality and Low Resource Face Data. There is a big difference in the tone of color of skin between dark and light skinned people. Despite this fact, most face recognition tasks almost all classical state of the art models are trained on datasets containing an overwhelming majority of light skinned face images. It is tedious to collect a huge amount of data for dark skinned faces and train a model from scratch. In this paper, we apply transfer learning on VGGFace to check how it works on recognising dark skinned mainly Ethiopian faces. The dataset is of low quality and low resource. Our experimental results show above 95 accuracy which indicates that transfer learning in such settings works.


Sublinear Time Spectral Density Estimation. We present a new sublinear time algorithm for approximating the spectral density (eigenvalue distribution) of an n times n normalized graph adjacency or Laplacian matrix. The algorithm recovers the spectrum up to epsilon accuracy in the Wasserstein 1 distance in O(n cdot text poly (1 epsilon)) time given sample access to the graph. This result compliments recent work by David Cohen Steiner, Weihao Kong, Christian Sohler, and Gregory Valiant (2018), which obtains a solution with runtime independent of n , but exponential in 1 epsilon . We conjecture that the trade off between dimension dependence and accuracy is inherent. Our method is simple and works well experimentally. It is based on a Chebyshev polynomial moment matching method that employees randomized estimators for the matrix trace. We prove that, for any Hermitian A , this moment matching method returns an epsilon approximation to the spectral density using just O( 1 epsilon ) matrix vector products with A . By leveraging stability properties of the Chebyshev polynomial three term recurrence, we then prove that the method is amenable to the use of coarse approximate matrix vector products. Our sublinear time algorithm follows from combining this result with a novel sampling algorithm for approximating matrix vector products with a normalized graph adjacency matrix. Of independent interest, we show a similar result for the widely used emph kernel polynomial method (KPM), proving that this practical algorithm nearly matches the theoretical guarantees of our moment matching method. Our analysis uses tools from Jackson's seminal work on approximation with positive polynomial kernels.


Further metrics for flash radiography source spots. Flash radiography of large hydrodynamic experiments driven by high explosives is a diagnostic method in use at many laboratories. A major contributor to the practical resolution obtained by this point projection technique is the size of the source spot. A variety of techniques for measuring spot size are in use at the different laboratories, as are different definitions of spot size. Additional metrics in common use at Los Alamos National Laboratory are considered here, and compared with those previously discussed in J. Opt. Soc.


Prescribed Webster scalar curvature flow on CR manifold. Using the prescribed Webster scalar curvature flow, we prove some existence results on the 3 dimensional compact CR manifold with nonnegative CR Yamabe constant.


Inertial primal dual methods for linear equality constrained convex optimization problems. In this paper, we propose an inertial accelerated primal dual method for the linear equality constrained convex optimization problem. When the objective function has a nonsmooth smooth'' composite structure, we further propose an inexact inertial primal dual method by linearizing the smooth individual function and solving the subproblem inexactly. Assuming merely convexity, we prove that the proposed methods enjoy mathcal O (1 k 2) convergence rate on the objective residual and the feasibility violation in the primal model. Numerical results are reported to demonstrate the validity of the proposed methods.


math.NA cs.NA physics.comp-ph physics.flu-dyn

A projection based, semi implicit time stepping approach for the Cahn Hilliard Navier Stokes equations on adaptive octree meshes. We present a projection based framework for solving a thermodynamically consistent Cahn Hilliard Navier Stokes system that models two phase flows. In this work we extend the fully implicit method presented in Khanwale et al. it A fully coupled framework for solving Cahn Hilliard Navier Stokes equations Second order, energy stable numerical methods on adaptive octree based meshes. , arXiv 2009.06628 (2020) , to a block iterative hybrid method. We use a projection based semi implicit time discretization for the Navier Stokes and a fully implicit time discretization for the Cahn Hilliard equation. We use a conforming continuous Galerkin (cG) finite element method in space equipped with a residual based variational multiscale (RBVMS) formulation. Pressure is decoupled using a projection step, which results in two linear positive semi definite systems for velocity and pressure, instead of the saddle point system of a pressure stabilized method. All the linear systems are solved using an efficient and scalable algebraic multigrid (AMG) method. We deploy this approach on a massively parallel numerical implementation using parallel octree based adaptive meshes. The overall approach allows the use of relatively large time steps with much faster time to solve. We present comprehensive numerical experiments showing detailed comparisons with results from the literature for canonical cases, including the single bubble rise and Rayleigh Taylor instability.


H GAN the power of GANs in your Hands. We present HandGAN (H GAN), a cycle consistent adversarial learning approach implementing multi scale perceptual discriminators. It is designed to translate synthetic images of hands to the real domain. Synthetic hands provide complete ground truth annotations, yet they are not representative of the target distribution of real world data. We strive to provide the perfect blend of a realistic hand appearance with synthetic annotations. Relying on image to image translation, we improve the appearance of synthetic hands to approximate the statistical distribution underlying a collection of real images of hands. H GAN tackles not only the cross domain tone mapping but also structural differences in localized areas such as shading discontinuities. Results are evaluated on a qualitative and quantitative basis improving previous works. Furthermore, we relied on the hand classification task to claim our generated hands are statistically similar to the real domain of hands.


Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies. A key limitation in current datasets for multi hop reasoning is that the required steps for answering the question are mentioned in it explicitly. In this work, we introduce StrategyQA, a question answering (QA) benchmark where the required reasoning steps are implicit in the question, and should be inferred using a strategy. A fundamental challenge in this setup is how to elicit such creative questions from crowdsourcing workers, while covering a broad range of potential strategies. We propose a data collection procedure that combines term based priming to inspire annotators, careful control over the annotator population, and adversarial filtering for eliminating reasoning shortcuts. Moreover, we annotate each question with (1) a decomposition into reasoning steps for answering it, and (2) Wikipedia paragraphs that contain the answers to each step. Overall, StrategyQA includes 2,780 examples, each consisting of a strategy question, its decomposition, and evidence paragraphs. Analysis shows that questions in StrategyQA are short, topic diverse, and cover a wide range of strategies. Empirically, we show that humans perform well (87 ) on this task, while our best baseline reaches an accuracy of sim 66 .


Lachesis Scalable Asynchronous BFT on DAG Streams. This paper consolidates the core technologies and key concepts of our novel Lachesis consensus protocol and Fantom Opera platform, which is permissionless, leaderless and EVM compatible. We introduce our new protocol, so called Lachesis, for distributed networks achieving Byzantine fault tolerance (BFT) cite lachesis01 . Each node in Lachesis protocol operates on a local block DAG, namely emph OPERA DAG . Aiming for a low time to finality (TTF) for transactions, our general model considers DAG streams of high speed but asynchronous events. We integrate Proof of Stake (PoS) into a DAG model in Lachesis protocol to improve performance and security. Our general model of trustless system leverages participants' stake as their validating power cite stakedag . Lachesis's consensus algorithm uses Lamport timestamps, graph layering and concurrent common knowledge to guarantee a consistent total ordering of event blocks and transactions. In addition, Lachesis protocol allows dynamic participation of new nodes into Opera network. Lachesis optimizes DAG storage and processing time by splitting local history into checkpoints (so called epochs). We also propose a model to improve stake decentralization, and network safety and liveness cite stairdag . Built on our novel Lachesis protocol, Fantom's Opera platform is a public, leaderless, asynchronous BFT, layer 1 blockchain, with guaranteed deterministic finality. Hence, Lachesis protocol is suitable for distributed ledgers by leveraging asynchronous partially ordered sets with logical time ordering instead of blockchains. We also present our proofs into a model that can be applied to abstract asynchronous distributed system.


Drawing Inspiration from Biological Dendrites to Empower Artificial Neural Networks. This article highlights specific features of biological neurons and their dendritic trees, whose adoption may help advance artificial neural networks used in various machine learning applications. Advancements could take the form of increased computational capabilities and or reduced power consumption. Proposed features include dendritic anatomy, dendritic nonlinearities, and compartmentalized plasticity rules, all of which shape learning and information processing in biological networks. We discuss the computational benefits provided by these features in biological neurons and suggest ways to adopt them in artificial neurons in order to exploit the respective benefits in machine learning.


Improving Event Causality Identification via Self Supervised Representation Learning on External Causal Statement. Current models for event causality identification (ECI) mainly adopt a supervised framework, which heavily rely on labeled data for training. Unfortunately, the scale of current annotated datasets is relatively limited, which cannot provide sufficient support for models to capture useful indicators from causal statements, especially for handing those new, unseen cases. To alleviate this problem, we propose a novel approach, shortly named CauSeRL, which leverages external causal statements for event causality identification. First of all, we design a self supervised framework to learn context specific causal patterns from external causal statements. Then, we adopt a contrastive transfer strategy to incorporate the learned context specific causal patterns into the target ECI model. Experimental results show that our method significantly outperforms previous methods on EventStoryLine and Causal TimeBank ( 2.0 and 3.4 points on F1 value respectively).


Learning Implicit User Profiles for Personalized Retrieval Based Chatbot. In this paper, we explore the problem of developing personalized chatbots. A personalized chatbot is designed as a digital chatting assistant for a user. The key characteristic of a personalized chatbot is that it should have a consistent personality with the corresponding user. It can talk the same way as the user when it is delegated to respond to others' messages. We present a retrieval based personalized chatbot model, namely IMPChat, to learn an implicit user profile from the user's dialogue history. We argue that the implicit user profile is superior to the explicit user profile regarding accessibility and flexibility. IMPChat aims to learn an implicit user profile through modeling user's personalized language style and personalized preferences separately. To learn a user's personalized language style, we elaborately build language models from shallow to deep using the user's historical responses To model a user's personalized preferences, we explore the conditional relations underneath each post response pair of the user. The personalized preferences are dynamic and context aware we assign higher weights to those historical pairs that are topically related to the current query when aggregating the personalized preferences. We match each response candidate with the personalized language style and personalized preference, respectively, and fuse the two matching signals to determine the final ranking score. Comprehensive experiments on two large datasets show that our method outperforms all baseline models.


Character Transformations for Non Autoregressive GEC Tagging. We propose a character based nonautoregressive GEC approach, with automatically generated character transformations. Recently, per word classification of correction edits has proven an efficient, parallelizable alternative to current encoder decoder GEC systems. We show that word replacement edits may be suboptimal and lead to explosion of rules for spelling, diacritization and errors in morphologically rich languages, and propose a method for generating character transformations from GEC corpus. Finally, we train character transformation models for Czech, German and Russian, reaching solid results and dramatic speedup compared to autoregressive systems. The source code is released at https github.com ufal wnut2021 character transformations gec.


ADJUST A Dictionary Based Joint Reconstruction and Unmixing Method for Spectral Tomography. Advances in multi spectral detectors are causing a paradigm shift in X ray Computed Tomography (CT). Spectral information acquired from these detectors can be used to extract volumetric material composition maps of the object of interest. If the materials and their spectral responses are known a priori, the image reconstruction step is rather straightforward. If they are not known, however, the maps as well as the responses need to be estimated jointly. A conventional workflow in spectral CT involves performing volume reconstruction followed by material decomposition, or vice versa. However, these methods inherently suffer from the ill posedness of the joint reconstruction problem. To resolve this issue, we propose A Dictionary based Joint reconstruction and Unmixing method for Spectral Tomography' (ADJUST). Our formulation relies on forming a dictionary of spectral signatures of materials common in CT and prior knowledge of the number of materials present in an object. In particular, we decompose the spectral volume linearly in terms of spatial material maps, a spectral dictionary, and the indicator of materials for the dictionary elements. We propose a memory efficient accelerated alternating proximal gradient method to find an approximate solution to the resulting bi convex problem. From numerical demonstrations on several synthetic phantoms, we observe that ADJUST performs exceedingly well when compared to other state of the art methods. Additionally, we address the robustness of ADJUST against limited measurement patterns.


Spectral Clustering Oracles in Sublinear Time. Given a graph G that can be partitioned into k disjoint expanders with outer conductance upper bounded by epsilon ll 1 , can we efficiently construct a small space data structure that allows quickly classifying vertices of G according to the expander (cluster) they belong to? Formally, we would like an efficient local computation algorithm that misclassifies at most an O( epsilon) fraction of vertices in every expander. We refer to such a data structure as a textit spectral clustering oracle . Our main result is a spectral clustering oracle with query time O (n 1 2 O( epsilon) ) and preprocessing time 2 O( frac 1 epsilon k 4 log 2(k)) n 1 2 O( epsilon) that provides misclassification error O( epsilon log k) per cluster for any epsilon ll 1 log k . More generally, query time can be reduced at the expense of increasing the preprocessing time appropriately (as long as the product is about n 1 O( epsilon) ) this in particular gives a nearly linear time spectral clustering primitive. The main technical contribution is a sublinear time oracle that provides dot product access to the spectral embedding of G by estimating distributions of short random walks from vertices in G . The distributions themselves provide a poor approximation to the spectral embedding, but we show that an appropriate linear transformation can be used to achieve high precision dot product access. We then show that dot product access to the spectral embedding is sufficient to design a clustering oracle. At a high level our approach amounts to hyperplane partitioning in the spectral embedding of G , but crucially operates on a nested sequence of carefully defined subspaces in the spectral embedding to achieve per cluster recovery guarantees.


Detecting Communities from Heterogeneous Graphs A Context Path based Graph Neural Network Model. Community detection, aiming to group the graph nodes into clusters with dense inner connection, is a fundamental graph mining task. Recently, it has been studied on the heterogeneous graph, which contains multiple types of nodes and edges, posing great challenges for modeling the high order relationship between nodes. With the surge of graph embedding mechanism, it has also been adopted to community detection. A remarkable group of works use the meta path to capture the high order relationship between nodes and embed them into nodes' embedding to facilitate community detection. However, defining meaningful meta paths requires much domain knowledge, which largely limits their applications, especially on schema rich heterogeneous graphs like knowledge graphs. To alleviate this issue, in this paper, we propose to exploit the context path to capture the high order relationship between nodes, and build a Context Path based Graph Neural Network (CP GNN) model. It recursively embeds the high order relationship between nodes into the node embedding with attention mechanisms to discriminate the importance of different relationships. By maximizing the expectation of the co occurrence of nodes connected by context paths, the model can learn the nodes' embeddings that both well preserve the high order relationship between nodes and are helpful for community detection. Extensive experimental results on four real world datasets show that CP GNN outperforms the state of the art community detection methods.


Possible benefit of longer L for detectors at ILC. In the present design of ILC, L , the distance between the interaction point (IP) and the front surface of the final focusing magnet (QD0), is 4.1 m. The QD0 is supported from the detector platform by a cantilever type support or from the detector itself. This design could cause several difficulties in smooth operation of ILC or in maintenance of detectors. These difficulties could be mitigated by adopting longer L optics. In this article, we discuss possible benefit of longer L for detectors.


Data driven prediction of complex flow field over an axisymmetric body of revolution using Machine Learning. Computationally efficient and accurate simulations of the flow over axisymmetric bodies of revolution (ABR) has been an important desideratum for engineering design. In this article the flow field over an ABR is predicted using machine learning (ML) algorithms, using trained ML models as surrogates for classical computational fluid dynamics (CFD) approaches. The flow field is approximated as functions of x and y coordinates of locations in the flow field and the velocity at the inlet of the computational domain. The data required for the development of the ML models were obtained from high fidelity Reynolds stress transport model (RSTM) based simulations. The optimal hyper parameters of the trained ML models are determined using validation. The trained ML models can predict the flow field rapidly and exhibits orders of magnitude speed up over conventional CFD approaches. The predicted results of pressure, velocity and turbulence kinetic energy are compared with the baseline CFD data, it is found that the ML based surrogate model predictions are as accurate as CFD results. This investigation offers a framework for fast and accurate predictions for a flow scenario that is critically important in engineering design.


Performance vs Programming Effort between Rust and C on Multicore Architectures Case Study in N Body. Historically, Fortran and C have been the default programming languages in High Performance Computing (HPC). In both, programmers have primitives and functions available that allow manipulating system memory and interacting directly with the underlying hardware, resulting in efficient code in both response times and resource use. On the other hand, it is a real challenge to generate code that is maintainable and scalable over time in these types of languages. In 2010, Rust emerged as a new programming language designed for concurrent and secure applications, which adopts features of procedural, object oriented and functional languages. Among its design principles, Rust is aimed at matching C in terms of efficiency, but with increased code security and productivity. This paper presents a comparative study between C and Rust in terms of performance and programming effort, selecting as a case study the simulation of N computational bodies (N Body), a popular problem in the HPC community. Based on the experimental work, it was possible to establish that Rust is a language that reduces programming effort while maintaining acceptable performance levels, meaning that it is a possible alternative to C for HPC.


Finiteness of reductions of Hecke orbits. We prove two finiteness results for reductions of Hecke orbits of abelian varieties over local fields one in the case of supersingular reduction and one in the case of reductive monodromy. As an application, we show that only finitely many abelian varieties on a fixed isogeny leaf admit CM lifts, which in particular implies that in each fixed dimension g only finitely many supersingular abelian varieties admit CM lifts. Combining this with the Kuga Satake construction, we also show that only finitely many supersingular K3 surfaces admit CM lifts. Our tools include p adic Hodge theory and group theoretic techniques.


X ray focusing by bent crystals focal positions as predicted by the crystal lens equation and the dynamical diffraction theory. The location of the beam focus when monochromatic x ray radiation is diffracted by a thin bent crystal is predicted by "crystal lens equation". We derive this equation in a general form valid for Bragg and Laue geometries. This equation has little utility for diffraction in Laue geometry. The focusing effect in the Laue symmetrical case is discussed using concepts of dynamical theory and an extension of the lens equation is proposed. The existence of polychromatic focusing is considered and the feasibility of matching the polychromatic and monochromatic focal positions is discussed.


TCLR Temporal Contrastive Learning for Video Representation. Contrastive learning has nearly closed the gap between supervised and self supervised learning of image representations, and has also been explored for videos. However, prior work on contrastive learning for video data has not explored the effect of explicitly encouraging the features to be distinct across the temporal dimension. We develop a new temporal contrastive learning framework consisting of two novel losses to improve upon existing contrastive self supervised video representation learning methods. The local local temporal contrastive loss adds the task of discriminating between non overlapping clips from the same video, whereas the global local temporal contrastive aims to discriminate between timesteps of the feature map of an input clip in order to increase the temporal diversity of the learned features. Our proposed temporal contrastive learning framework achieves significant improvement over the state of the art results in various downstream video understanding tasks such as action recognition, limited label action classification, and nearest neighbor video retrieval on multiple video datasets and backbones. We also demonstrate significant improvement in fine grained action classification for visually similar classes. With the commonly used 3D ResNet 18 architecture with UCF101 pretraining, we achieve 82.4 ( 5.1 increase over the previous best) top 1 accuracy on UCF101 and 52.9 ( 5.4 increase) on HMDB51 action classification, and 56.2 ( 11.7 increase) Top 1 Recall on UCF101 nearest neighbor video retrieval. Code released at github.com DAVEISHAN TCLR.


physics.comp-ph cs.AI cs.LG cs.NA math.NA physics.ao-ph

Physics informed neural networks for the shallow water equations on the sphere. We propose the use of physics informed neural networks for solving the shallow water equations on the sphere in the meteorological context. Physics informed neural networks are trained to satisfy the differential equations along with the prescribed initial and boundary data, and thus can be seen as an alternative approach to solving differential equations compared to traditional numerical approaches such as finite difference, finite volume or spectral methods. We discuss the training difficulties of physics informed neural networks for the shallow water equations on the sphere and propose a simple multi model approach to tackle test cases of comparatively long time intervals. Here we train a sequence of neural networks instead of a single neural network for the entire integration interval. We also avoid the use of a boundary value loss by encoding the boundary conditions in a custom neural network layer. We illustrate the abilities of the method by solving the most prominent test cases proposed by Williamson et al. J. Comput. Phys. 102 (1992), 211 224 .


Totally real bi quadratic fields with large P ' o lya groups. For an algebraic number field K with ring of integers mathcal O K , an important subgroup of the ideal class group Cl K is the it P ' o lya group , denoted by Po(K) , which measures the failure of the mathcal O K module Int( mathcal O K ) of integer valued polynomials on mathcal O K from admitting a regular basis. In this paper, we prove that for any integer n geq 2 , there are infinitely many totally real bi quadratic fields K with Po(K) 2 n . In fact, we explicitly construct such an infinite family of number fields. This extends an infinite family of bi quadratic fields with P ' o lya group mathbb Z 2 mathbb Z given by the authors in cite self ja . This also provides an infinite family of bi quadratic fields with class numbers divisible by 2 n .


Subgradient Ellipsoid Method for Nonsmooth Convex Problems. In this paper, we present a new ellipsoid type algorithm for solving nonsmooth problems with convex structure. Examples of such problems include nonsmooth convex minimization problems, convex concave saddle point problems and variational inequalities with monotone operator. Our algorithm can be seen as a combination of the standard Subgradient and Ellipsoid methods. However, in contrast to the latter one, the proposed method has a reasonable convergence rate even when the dimensionality of the problem is sufficiently large. For generating accuracy certificates in our algorithm, we propose an efficient technique, which ameliorates the previously known recipes.


EXPATS A Toolkit for Explainable Automated Text Scoring. Automated text scoring (ATS) tasks, such as automated essay scoring and readability assessment, are important educational applications of natural language processing. Due to their interpretability of models and predictions, traditional machine learning (ML) algorithms based on handcrafted features are still in wide use for ATS tasks. Practitioners often need to experiment with a variety of models (including deep and traditional ML ones), features, and training objectives (regression and classification), although modern deep learning frameworks such as PyTorch require deep ML expertise to fully utilize. In this paper, we present EXPATS, an open source framework to allow its users to develop and experiment with different ATS models quickly by offering flexible components, an easy to use configuration system, and the command line interface. The toolkit also provides seamless integration with the Language Interpretability Tool (LIT) so that one can interpret and visualize models and their predictions. We also describe two case studies where we build ATS models quickly with minimal engineering efforts. The toolkit is available at url https github.com octanove expats .


From the Head or the Heart? An Experimental Design on the Impact of Explanation on Cognitive and Affective Trust. Automated vehicles (AVs) are social robots that can potentially benefit our society. According to the existing literature, AV explanations can promote passengers' trust by reducing the uncertainty associated with the AV's reasoning and actions. However, the literature on AV explanations and trust has failed to consider how the type of trust cognitive versus affective might alter this relationship. Yet, the existing literature has shown that the implications associated with trust vary widely depending on whether it is cognitive or affective. To address this shortcoming and better understand the impacts of explanations on trust in AVs, we designed a study to investigate the effectiveness of explanations on both cognitive and affective trust. We expect these results to be of great significance in designing AV explanations to promote AV trust.


Axiomatizations and Computability of Weighted Monadic Second Order Logic. Weighted monadic second order logic is a weighted extension of monadic second order logic that captures exactly the behaviour of weighted automata. Its semantics is parameterized with respect to a semiring on which the values that weighted formulas output are evaluated. Gastin and Monmege (2018) gave abstract semantics for a version of weighted monadic second order logic to give a more general and modular proof of the equivalence of the logic with weighted automata. We focus on the abstract semantics of the logic and we give a complete axiomatization both for the full logic and for a fragment without general sum, thus giving a more fine grained understanding of the logic. We discuss how common decision problems for logical languages can be adapted to the weighted setting, and show that many of these are decidable, though they inherit bad complexity from the underlying first and second order logics. However, we show that a weighted adaptation of satisfiability is undecidable for the logic when one uses the abstract interpretation.


Corner case data description and detection. As the major factors affecting the safety of deep learning models, corner cases and related detection are crucial in AI quality assurance for constructing safety and security critical systems. The generic corner case researches involve two interesting topics. One is to enhance DL models robustness to corner case data via the adjustment on parameters structure. The other is to generate new corner cases for model retraining and improvement. However, the complex architecture and the huge amount of parameters make the robust adjustment of DL models not easy, meanwhile it is not possible to generate all real world corner cases for DL training. Therefore, this paper proposes to a simple and novel study aiming at corner case data detection via a specific metric. This metric is developed on surprise adequacy (SA) which has advantages on capture data behaviors. Furthermore, targeting at characteristics of corner case data, three modifications on distanced based SA are developed for classification applications in this paper. Consequently, through the experiment analysis on MNIST data and industrial data, the feasibility and usefulness of the proposed method on corner case data detection are verified.


Obstruction to naive liftability of DG modules. The notion of naive liftability of DG modules is introduced in 9 and 10 . In this paper, we study the obstruction to naive liftability along extensions A to B of DG algebras, where B is projective as an underlying graded A module. We show that the obstruction to naive liftability of a semifree DG B module N is a certain cohomology class in Ext 1 B(N,N otimes B J) , where J is the diagonal ideal. Our results on obstruction class enable us to give concrete examples of DG modules that do and do not satisfy the naive lifting property.


Are Investors Biased Against Women? Analyzing How Gender Affects Startup Funding in Europe. One of the main challenges of startups is to raise capital from investors. For startup founders, it is therefore crucial to know whether investors have a bias against women as startup founders and in which way startups face disadvantages due to gender bias. Existing works on gender studies have mainly analyzed the US market. In this paper, we aim to give a more comprehensive picture of gender bias in early stage startup funding. We examine European startups listed on Crunchbase using Semantic Web technologies and analyze how the share of female founders in a founding team affects the funding amount. We find that the relative amount of female founders has a negative impact on the funding raised. Furthermore, we observe that founder characteristics have an effect on the funding raised based on the founders' gender. Moreover, we find that gender bias in early stage funding is less prevalent for serial founders with entrepreneurial experience as female founders benefit three times more than male founders from already having founded a startup. Overall, our study suggests that gender bias exists and is worth to be considered in the context of startup funding.


Construction of coend and the reconstruction theorem of bialgebras. Assume k is a field and let F C rightarrow Vect k be a small k linear functor from a k linear abelian category C to the category of vector spaces over the field k , the purpose of this note is to use a little knowledge of linear algebra and category to give the description of end(F) and coend(F) , and then we give the reconstruction theorem of bialgebras by using this description. We use a constructive approach to understand end(F),coend(F) and we describe the bialgebra structure of coend(F) concretely when F is a tensor functor.


A Normalized Gaussian Wasserstein Distance for Tiny Object Detection. Detecting tiny objects is a very challenging problem since a tiny object only contains a few pixels in size. We demonstrate that state of the art detectors do not produce satisfactory results on tiny objects due to the lack of appearance information. Our key observation is that Intersection over Union (IoU) based metrics such as IoU itself and its extensions are very sensitive to the location deviation of the tiny objects, and drastically deteriorate the detection performance when used in anchor based detectors. To alleviate this, we propose a new evaluation metric using Wasserstein distance for tiny object detection. Specifically, we first model the bounding boxes as 2D Gaussian distributions and then propose a new metric dubbed Normalized Wasserstein Distance (NWD) to compute the similarity between them by their corresponding Gaussian distributions. The proposed NWD metric can be easily embedded into the assignment, non maximum suppression, and loss function of any anchor based detector to replace the commonly used IoU metric. We evaluate our metric on a new dataset for tiny object detection (AI TOD) in which the average object size is much smaller than existing object detection datasets. Extensive experiments show that, when equipped with NWD metric, our approach yields performance that is 6.7 AP points higher than a standard fine tuning baseline, and 6.0 AP points higher than state of the art competitors.


Revisiting Non Specific Syndromic Surveillance. Infectious disease surveillance is of great importance for the prevention of major outbreaks. Syndromic surveillance aims at developing algorithms which can detect outbreaks as early as possible by monitoring data sources which allow to capture the occurrences of a certain disease. Recent research mainly focuses on the surveillance of specific, known diseases, putting the focus on the definition of the disease pattern under surveillance. Until now, only little effort has been devoted to what we call non specific syndromic surveillance, i.e., the use of all available data for detecting any kind of outbreaks, including infectious diseases which are unknown beforehand. In this work, we revisit published approaches for non specific syndromic surveillance and present a set of simple statistical modeling techniques which can serve as benchmarks for more elaborate machine learning approaches. Our experimental comparison on established synthetic data and real data in which we injected synthetic outbreaks shows that these benchmarks already achieve very competitive results and often outperform more elaborate algorithms.


Splines for Image Metamorphosis. This paper investigates a variational model for splines in the image metamorphosis model for the the smooth interpolation of key frames in the space of images. The original metamorphosis model is based on a simultaneous transport of image intensities and a modulation of intensities along motion trajectories and the energy functional measures the motion velocity and the material derivative of the image intensity. As in the case of cubic splines in Euclidean space where cubic splines are known to minimize the squared acceleration along the interpolation path we consider different acceleration terms to define a spline metamorphis model. In fact, the proposed spline functional combines quadratic functionals of the Eulerian motion acceleration and of the second material derivative representing an acceleration in the change of intensities along motion paths. Furthermore, a variational time discretization of this spline model is proposed and the convergence to a suitably relaxed time continuous model is discussed via Gamma convergence methodology. As a byproduct, this also allows to establish the existence of metamorphosis splines for given key frame images as minimizers of the continuous spline functional. An effective spatial discretization is proposed based on a finite difference discretization in space combined with a stable B spline interpolation of deformed quantities. A variety of numerical examples demonstrates the robustness and versatility of the proposed method in applications using a variant of the iPALM algorithm for the minimization of the fully discrete energy functional.


Benchmarking the Benchmark Analysis of Synthetic NIDS Datasets. Network Intrusion Detection Systems (NIDSs) are an increasingly important tool for the prevention and mitigation of cyber attacks. A number of labelled synthetic datasets generated have been generated and made publicly available by researchers, and they have become the benchmarks via which new ML based NIDS classifiers are being evaluated. Recently published results show excellent classification performance with these datasets, increasingly approaching 100 percent performance across key evaluation metrics such as accuracy, F1 score, etc. Unfortunately, we have not yet seen these excellent academic research results translated into practical NIDS systems with such near perfect performance. This motivated our research presented in this paper, where we analyse the statistical properties of the benign traffic in three of the more recent and relevant NIDS datasets, (CIC, UNSW, ...). As a comparison, we consider two datasets obtained from real world production networks, one from a university network and one from a medium size Internet Service Provider (ISP). Our results show that the two real world datasets are quite similar among themselves in regards to most of the considered statistical features. Equally, the three synthetic datasets are also relatively similar within their group. However, and most importantly, our results show a distinct difference of most of the considered statistical features between the three synthetic datasets and the two real world datasets. Since ML relies on the basic assumption of training and test datasets being sampled from the same distribution, this raises the question of how well the performance results of ML classifiers trained on the considered synthetic datasets can translate and generalise to real world networks. We believe this is an interesting and relevant question which provides motivation for further research in this space.


Realism is almost true A critique of the interface theory of perception. Objective reality and its relation to our perception have been an important topic of debate in philosophy and cognitive science. Hoffman's "interface theory of perception," which asserts that our perception has no congruency with reality, is recent and controversial among existing theories. Hoffman and Prakash formulated and evaluated their theory using evolutionary game theory and genetic algorithms. This paper investigates the "interface theory of perception," introducing an agent based simulation. Using the principles and hypothesis of Hoffman's model, first, we regenerate and approve his initial claims to consider interface as a winning perception strategy. Then we move forward to assess his model in more realistic conditions and challenge interface perception model. Our findings indicate that in case of drastic environmental changes, interface perception is no longer compatible with reality and pushes the interface species further toward extinction. Our proposed model will pave the road for future studies to investigate the perception strategies in a more realistic condition.


The Labeled Multiple Canonical Correlation Analysis for Information Fusion. The objective of multimodal information fusion is to mathematically analyze information carried in different sources and create a new representation which will be more effectively utilized in pattern recognition and other multimedia information processing tasks. In this paper, we introduce a new method for multimodal information fusion and representation based on the Labeled Multiple Canonical Correlation Analysis (LMCCA). By incorporating class label information of the training samples,the proposed LMCCA ensures that the fused features carry discriminative characteristics of the multimodal information representations, and are capable of providing superior recognition performance. We implement a prototype of LMCCA to demonstrate its effectiveness on handwritten digit recognition,face recognition and object recognition utilizing multiple features,bimodal human emotion recognition involving information from both audio and visual domains. The generic nature of LMCCA allows it to take as input features extracted by any means,including those by deep learning (DL) methods. Experimental results show that the proposed method enhanced the performance of both statistical machine learning (SML) methods, and methods based on DL.


A learning gap between neuroscience and reinforcement learning. Historically, artificial intelligence has drawn much inspiration from neuroscience to fuel advances in the field. However, current progress in reinforcement learning is largely focused on benchmark problems that fail to capture many of the aspects that are of interest in neuroscience today. We illustrate this point by extending a T maze task from neuroscience for use with reinforcement learning algorithms, and show that state of the art algorithms are not capable of solving this problem. Finally, we point out where insights from neuroscience could help explain some of the issues encountered.


Podracer architectures for scalable Reinforcement Learning. Supporting state of the art AI research requires balancing rapid prototyping, ease of use, and quick iteration, with the ability to deploy experiments at a scale traditionally associated with production systems.Deep learning frameworks such as TensorFlow, PyTorch and JAX allow users to transparently make use of accelerators, such as TPUs and GPUs, to offload the more computationally intensive parts of training and inference in modern deep learning systems. Popular training pipelines that use these frameworks for deep learning typically focus on (un )supervised learning. How to best train reinforcement learning (RL) agents at scale is still an active research area. In this report we argue that TPUs are particularly well suited for training RL agents in a scalable, efficient and reproducible way. Specifically we describe two architectures designed to make the best use of the resources available on a TPU Pod (a special configuration in a Google data center that features multiple TPU devices connected to each other by extremely low latency communication channels).


Process discovery on deviant traces and other stranger things. As the need to understand and formalise business processes into a model has grown over the last years, the process discovery research field has gained more and more importance, developing two different classes of approaches to model representation procedural and declarative. Orthogonally to this classification, the vast majority of works envisage the discovery task as a one class supervised learning process guided by the traces that are recorded into an input log. In this work instead, we focus on declarative processes and embrace the less popular view of process discovery as a binary supervised learning task, where the input log reports both examples of the normal system execution, and traces representing "stranger" behaviours according to the domain semantics. We therefore deepen how the valuable information brought by both these two sets can be extracted and formalised into a model that is "optimal" according to user defined goals. Our approach, namely NegDis, is evaluated w.r.t. other relevant works in this field, and shows promising results as regards both the performance and the quality of the obtained solution.


CARTL Cooperative Adversarially Robust Transfer Learning. Transfer learning eases the burden of training a well performed model from scratch, especially when training data is scarce and computation power is limited. In deep learning, a typical strategy for transfer learning is to freeze the early layers of a pre trained model and fine tune the rest of its layers on the target domain. Previous work focuses on the accuracy of the transferred model but neglects the transfer of adversarial robustness. In this work, we first show that transfer learning improves the accuracy on the target domain but degrades the inherited robustness of the target model. To address such a problem, we propose a novel cooperative adversarially robust transfer learning (CARTL) by pre training the model via feature distance minimization and fine tuning the pre trained model with non expansive fine tuning for target domain tasks. Empirical results show that CARTL improves the inherited robustness by about 28 at most compared with the baseline with the same degree of accuracy. Furthermore, we study the relationship between the batch normalization (BN) layers and the robustness in the context of transfer learning, and we reveal that freezing BN layers can further boost the robustness transfer.


A Student Teacher Architecture for Dialog Domain Adaptation under the Meta Learning Setting. Numerous new dialog domains are being created every day while collecting data for these domains is extremely costly since it involves human interactions. Therefore, it is essential to develop algorithms that can adapt to different domains efficiently when building data driven dialog models. The most recent researches on domain adaption focus on giving the model a better initialization, rather than optimizing the adaptation process. We propose an efficient domain adaptive task oriented dialog system model, which incorporates a meta teacher model to emphasize the different impacts between generated tokens with respect to the context. We first train our base dialog model and meta teacher model adversarially in a meta learning setting on rich resource domains. The meta teacher learns to quantify the importance of tokens under different contexts across different domains. During adaptation, the meta teacher guides the dialog model to focus on important tokens in order to achieve better adaptation efficiency. We evaluate our model on two multi domain datasets, MultiWOZ and Google Schema Guided Dialogue, and achieve state of the art performance.


Growth and Evaluation of Improved CsI Tl and NaI Tl Scintillators. Scintillators play an important role in radiation detection and imaging. Thallium doped cesium iodide (CsI Tl) and sodium iodide (NaI Tl) are two of the major scintillators that have been used for many applications for many decades. In this paper we will present an improved scintillation performance of Bridgman method grown CsI(Tl) and NaI(Tl) crystals developed by Xtallized Intelligence, Inc. (XI, Inc.) and we will compare the performance with commercially available CsI Tl and NaI Tl. In a preliminary testing using MicroFJ 60035 TSV silicon photomultipliers (ON Semiconductor), the newly developed and improved 12.5x12.5x6 mm3 CsI Tl crystal has shown an energy resolution of 4.8 (FWHM) at 662 keV, compared to 7.2 obtained by a commercially available CsI Tl with a size of 12.5x12.5x25 mm3. Energy resolution of 5.4 (FWHM) at 662 keV is obtained for the newly improved NaI Tl crystal, compared to 7 obtained by a commercially available 1 in. dia. x 1 in. NaI(Tl). Comparison of the photo peak channel locations shows that the improved CsI Tl and NaI Tl developed by XI, Inc. have produced much larger signal amplitudes when compared to the commercially available CsI(Tl) and NaI Tl. Improved decay time constants are presented as well.


Differentiable Rendering with Perturbed Optimizers. Reasoning about 3D scenes from their 2D image projections is one of the core problems in computer vision. Solutions to this inverse and ill posed problem typically involve a search for models that best explain observed image data. Notably, images depend both on the properties of observed scenes and on the process of image formation. Hence, if optimization techniques should be used to explain images, it is crucial to design differentiable functions for the projection of 3D scenes into images, also known as differentiable rendering. Previous approaches to differentiable rendering typically replace non differentiable operations by smooth approximations, impacting the subsequent 3D estimation. In this paper, we take a more general approach and study differentiable renderers through the prism of randomized optimization and the related notion of perturbed optimizers. In particular, our work highlights the link between some well known differentiable renderer formulations and randomly smoothed optimizers, and introduces differentiable perturbed renderers. We also propose a variance reduction mechanism to alleviate the computational burden inherent to perturbed optimizers and introduce an adaptive scheme to automatically adjust the smoothing parameters of the rendering process. We apply our method to 3D scene reconstruction and demonstrate its advantages on the tasks of 6D pose estimation and 3D mesh reconstruction. By providing informative gradients that can be used as a strong supervisory signal, we demonstrate the benefits of perturbed renderers to obtain more accurate solutions when compared to the state of the art alternatives using smooth gradient approximations.


The method of Bregman projections in deterministic and stochastic convex feasibility problems. In this work we study the method of Bregman projections for deterministic and stochastic convex feasibility problems with three types of control sequences for the selection of sets during the algorithmic procedure greedy, random, and adaptive random. We analyze in depth the case of affine feasibility problems showing that the iterates generated by the proposed methods converge Q linearly and providing also explicit global and local rates of convergence. This work generalizes from one hand recent developments in randomized methods for the solution of linear systems based on orthogonal projection methods. On the other hand, our results yield global and local Q linear rates of convergence for the Sinkhorn and Greenhorn algorithms in discrete entropic regularized optimal transport, for the first time, even in the multimarginal setting.


L q regularity for nonlinear elliptic equations with Schr "odinger type lower order terms. We consider nonlinear elliptic equations of the p Laplacian type with lower order terms which involve nonnegative potentials satisfying a reverse H "older type condition. Then we obtain interior and boundary L q estimates for the gradient of weak solutions and the lower order terms, independently, under sharp regularity conditions on the coefficients and the boundaries. In particular, the proof in this paper does not employ Fefferman Phong type inequalities which are essential tools in the linear cases in 3,47 .


Threat Landscape for Smart Grid Systems. Smart Grids are energy delivery networks, constituting an evolution of power grids, in which a bidirectional flow between power providers and consumers is established. These flows support the transfer of electricity and information, in order to support automation actions in the context of the energy delivery network. Insofar, many smart grid implementations and implementation proposals have emerged, with varying degrees of feature delivery and sophistication. While smart grids offer many advantages, their distributed nature and information flow streams between energy producers and consumers enable the launching of a number of attacks against the smart grid infrastructure, where the related consequences may range from economic loss to complete failure of the smart grid. In this paper, we survey the threat landscape of smart grids, identifying threats that are specific to this infrastructure, providing an assessment of the severity of the consequences of each attack type, discerning features that can be utilized to detect attacks and listing methods that can be used to mitigate them.


Supervised Transfer Learning at Scale for Medical Imaging. Transfer learning is a standard technique to improve performance on tasks with limited data. However, for medical imaging, the value of transfer learning is less clear. This is likely due to the large domain mismatch between the usual natural image pre training (e.g. ImageNet) and medical images. However, recent advances in transfer learning have shown substantial improvements from scale. We investigate whether modern methods can change the fortune of transfer learning for medical imaging. For this, we study the class of large scale pre trained networks presented by Kolesnikov et al. on three diverse imaging tasks chest radiography, mammography, and dermatology. We study both transfer performance and critical properties for the deployment in the medical domain, including out of distribution generalization, data efficiency, sub group fairness, and uncertainty estimation. Interestingly, we find that for some of these properties transfer from natural to medical images is indeed extremely effective, but only when performed at sufficient scale.


Model Checking Finite Horizon Markov Chains with Probabilistic Inference. We revisit the symbolic verification of Markov chains with respect to finite horizon reachability properties. The prevalent approach iteratively computes step bounded state reachability probabilities. By contrast, recent advances in probabilistic inference suggest symbolically representing all horizon length paths through the Markov chain. We ask whether this perspective advances the state of the art in probabilistic model checking. First, we formally describe both approaches in order to highlight their key differences. Then, using these insights we develop Rubicon, a tool that transpiles Prism models to the probabilistic inference tool Dice. Finally, we demonstrate better scalability compared to probabilistic model checkers on selected benchmarks. All together, our results suggest that probabilistic inference is a valuable addition to the probabilistic model checking portfolio with Rubicon as a first step towards integrating both perspectives.


Leveraging Spatial and Photometric Context for Calibrated Non Lambertian Photometric Stereo. The problem of estimating a surface shape from its observed reflectance properties still remains a challenging task in computer vision. The presence of global illumination effects such as inter reflections or cast shadows makes the task particularly difficult for non convex real world surfaces. State of the art methods for calibrated photometric stereo address these issues using convolutional neural networks (CNNs) that primarily aim to capture either the spatial context among adjacent pixels or the photometric one formed by illuminating a sample from adjacent directions. In this paper, we bridge these two objectives and introduce an efficient fully convolutional architecture that can leverage both spatial and photometric context simultaneously. In contrast to existing approaches that rely on standard 2D CNNs and regress directly to surface normals, we argue that using separable 4D convolutions and regressing to 2D Gaussian heat maps severely reduces the size of the network and makes inference more efficient. Our experimental results on a real world photometric stereo benchmark show that the proposed approach outperforms the existing methods both in efficiency and accuracy.


Learning Connectivity with Graph Convolutional Networks for Skeleton based Action Recognition. Learning graph convolutional networks (GCNs) is an emerging field which aims at generalizing convolutional operations to arbitrary non regular domains. In particular, GCNs operating on spatial domains show superior performances compared to spectral ones, however their success is highly dependent on how the topology of input graphs is defined. In this paper, we introduce a novel framework for graph convolutional networks that learns the topological properties of graphs. The design principle of our method is based on the optimization of a constrained objective function which learns not only the usual convolutional parameters in GCNs but also a transformation basis that conveys the most relevant topological relationships in these graphs. Experiments conducted on the challenging task of skeleton based action recognition shows the superiority of the proposed method compared to handcrafted graph design as well as the related work.


Secretive Coded Caching with Shared Caches. We consider the problem of emph secretive coded caching in a shared cache setup where the number of users accessing a particular emph helper cache is more than one, and every user can access exactly one helper cache. In secretive coded caching, the constraint of emph perfect secrecy must be satisfied. It requires that the users should not gain, either from their caches or from the transmissions, any information about the content of the files that they did not request from the server. In order to accommodate the secrecy constraint, our problem setup requires, in addition to a helper cache, a dedicated emph user cache of minimum capacity of 1 unit to every user. This is where our formulation differs from the original work on shared caches ( Fundamental Limits of Coded Caching With Multiple Antennas, Shared Caches and Uncoded Prefetching'' by E. Parrinello, A. " U nsal and P. Elia in Trans. Inf. Theory, 2020). In this work, we propose a secretively achievable coded caching scheme with shared caches under centralized placement. When our scheme is applied to the dedicated cache setting, it matches the scheme by Ravindrakumar emph et al. ( Private Coded Caching'', in Trans. Inf. Forensics and Security, 2018).


Off policy Imitation Learning from Visual Inputs. Recently, various successful applications utilizing expert states in imitation learning (IL) have been witnessed. However, another IL setting IL from visual inputs (ILfVI), which has a greater promise to be applied in reality by utilizing online visual resources, suffers from low data efficiency and poor performance resulted from an on policy learning manner and high dimensional visual inputs. We propose OPIfVI (Off Policy Imitation from Visual Inputs), which is composed of an off policy learning manner, data augmentation, and encoder techniques, to tackle the mentioned challenges, respectively. More specifically, to improve data efficiency, OPIfVI conducts IL in an off policy manner, with which sampled data can be used multiple times. In addition, we enhance the stability of OPIfVI with spectral normalization to mitigate the side effect of off policy training. The core factor, contributing to the poor performance of ILfVI, that we think is the agent could not extract meaningful features from visual inputs. Hence, OPIfVI employs data augmentation from computer vision to help train encoders that can better extract features from visual inputs. In addition, a specific structure of gradient backpropagation for the encoder is designed to stabilize the encoder training. At last, we demonstrate that OPIfVI is able to achieve expert level performance and outperform existing baselines no matter visual demonstrations or visual observations are provided via extensive experiments using DeepMind Control Suite.


Byzantine Agreement with Unknown Participants and Failures. A set of mutually distrusting participants that want to agree on a common opinion must solve an instance of a Byzantine agreement problem. These problems have been extensively studied in the literature. However, most of the existing solutions assume that the participants are aware of n the total number of participants in the system and f an upper bound on the number of Byzantine participants. In this paper, we show that most of the fundamental agreement problems can be solved without affecting resiliency even if the participants do not know the values of (possibly changing) n and f . Specifically, we consider a synchronous system where the participants have unique but not necessarily consecutive identifiers, and give Byzantine agreement algorithms for reliable broadcast, approximate agreement, rotor coordinator, early terminating consensus and total ordering in static and dynamic systems, all with the optimal resiliency of n 3f . Moreover, we show that synchrony is necessary as an agreement with probabilistic termination is impossible in a semi synchronous or asynchronous system if the participants are unaware of n and f .


Regularity of the drift for random walks in groups acting on Gromov hyperbolic spaces. In this work we prove the continuity and existence of large deviations for the drift of random walks on groups acting by isometries on Gromov Hyperbolic Spaces. Through the process we refine the multiplicative ergodic theorem of Karlsson and Gou "ezel for such spaces. The works goes beyond what is known in the literature by allowing spaces that are not necessarily proper.


Towards Decentralized Complex Queries over Distributed Ledgers a Data Marketplace Use case. Distributed Ledger Technologies (DLT) and Decentralized File Storages (DFS) are becoming increasingly used to create common, decentralized and trustless infrastructures where participants interact and collaborate in Peer to Peer interactions. A prominent use case is represented by decentralized data marketplaces, where users are consumers and providers at the same time, and trustless interactions are required. However, data in DLTs and DFS are usually unstructured and there are no efficient mechanisms to query a certain type of data for the search in the market. In this paper, we propose the use of a Distributed Hash Table (DHT) as a layer on top of DLTs where, once the data are acquired and stored in the ledger, these can be searched through multiple keyword based queries, thanks to the lookup functionalities offered by the DHT. The DHT network is a hypercube overlay structure, organized for an efficient processing of multiple keyword based queries. We provide the architecture of such solution for a decentralized data marketplace and an analysis based on a simulation that proves the viability of the proposed approach.


Learning Graph Partitions. Given a partition of a graph into connected components, the membership oracle asserts whether any two vertices of the graph lie in the same component or not. We prove that for n ge k ge 2 , learning the components of an n vertex hidden graph with k components requires at least frac 1 2 (n k)(k 1) membership queries. This proves the optimality of the O(nk) algorithm proposed by Reyzin and Srivastava (2007) for this problem, improving on the best known information theoretic bound of Omega(n log k) queries. Further, we construct an oracle that can learn the number of components of G in asymptotically fewer queries than learning the full partition, thus answering another question posed by the same authors. Lastly, we introduce a more applicable version of this oracle, and prove asymptotically tight bounds of widetilde Theta(m) queries for both learning and verifying an m edge hidden graph G using this oracle.


The distribution of values of zeta and L functions. This is a survey of recent progress on understanding the value distribution of zeta and L functions. The article is intended for the 2022 ICM.


F RouND Fog based Rogue Nodes Detection in Vehicular Ad hoc Networks. Vehicular ad hoc networks (VANETs) facilitate vehicles to broadcast beacon messages to ensure road safety. The rogue nodes in VANETs broadcast malicious information leading to potential hazards, including the collision of vehicles. Previous researchers used either cryptography, trust values, or past vehicle data to detect rogue nodes, but they suffer from high processing delay, overhead, and false positive rate (FPR). We propose fog based rogue nodes detection (F RouND), a fog computing scheme, which dynamically creates a fog utilizing the on board units (OBUs) of all vehicles in the region for rogue nodes detection. The novelty of F RouND lies in providing low processing delays and FPR at high vehicle densities. The performance of our F RouND framework was carried out with simulations using OMNET and SUMO simulators. Results show that F RouND ensures 45 lower processing delays, 12 lower overhead, and 36 lower FPR at high vehicle densities compared to existing rogue nodes detection schemes.


Index bounded relative symplectic cohomology. We study the relative symplectic cohomology with the help of an index bounded contact form. For a Liouville domain with an index bounded boundary, we construct a spectral sequence which starts from its classical symplectic cohomology and converges to the relative symplectic cohomology of it inside a Calabi Yau manifold. In the appendix we compare the relative symplectic cohomology of a Liouville domain inside its completion with its classical symplectic cohomology. As an application, we obtain a version of the Viterbo isomorphism.


The Eigenvectors of Single spiked Complex Wishart Matrices Finite and Asymptotic Analyses. Let mathbf W in mathbb C n times n be a it single spiked Wishart matrix in the class mathbf W sim mathcal CW n(m, mathbf I n theta mathbf v mathbf v dagger) with m geq n , where mathbf I n is the n times n identity matrix, mathbf v in mathbb C n times 1 is an arbitrary vector with unit Euclidean norm, theta geq 0 is a non random parameter, and ( cdot) dagger represents the conjugate transpose operator. Let mathbf u 1 and mathbf u n denote the eigenvectors corresponding to the samllest and the largest eigenvalues of mathbf W , respectively. This paper investigates the probability density function (p.d.f.) of the random quantity Z ell (n) left mathbf v dagger mathbf u ell right 2 in(0,1) for ell 1,n . In particular, we derive a finite dimensional closed form p.d.f. for Z 1 (n) which is amenable to asymptotic analysis as m,n diverges with m n fixed. It turns out that, in this asymptotic regime, the scaled random variable nZ 1 (n) converges in distribution to chi 2 2 2(1 theta) , where chi 2 2 denotes a chi squared random variable with two degrees of freedom. This reveals that mathbf u 1 can be used to infer information about the spike. On the other hand, the finite dimensional p.d.f. of Z n (n) is expressed as a double integral in which the integrand contains a determinant of a square matrix of dimension (n 2) . Although a simple solution to this double integral seems intractable, for special configurations of n 2,3 , and 4 , we obtain closed form expressions.


An uniform version of Dvir and Moran's theorem. Dvir and Moran proved the following upper bound for the size of a family mbox cal F of subsets of n with mbox Vdim ( mbox cal F Delta mbox cal F ) leq d . Let d leq n be integers. Let mbox cal F be a family of subsets of n with mbox Vdim ( mbox cal F Delta mbox cal F ) leq d . Then left mbox cal F right le 2 sum k 0 lfloor d 2 rfloor binom nk. Our main result is the following uniform version of Dvir and Moran's result. Let d leq n be integers. Let mbox cal F be an uniform family of subsets of n with mbox Vdim ( mbox cal F Delta mbox cal F ) leq d . Then left mbox cal F right le 2 n choose lfloor d 2 rfloor . Denote by mathbf v F in 0,1 n the characteristic vector of a set F subseteq n . Our proof is based on the following uniform version of Croot Lev Pach Lemma Let 0 leq d leq n be integers. Let mbox cal H be a k uniform family of subsets of n . Let mathbb F be a field. Suppose that there exists a polynomial P(x 1, ldots ,x n,y 1, ldots ,y n) in mathbb F x 1, ldots ,x n,y 1, ldots ,y n with mbox deg (P) leq d such that P( mathbf v F , mathbf v F ) ne 0 for each F in mbox cal H and P( mathbf v F , mathbf v G ) 0 for each F ne G in mbox cal H . Then left mbox cal H right le 2 n choose lfloor d 2 rfloor .


Effective transcendental Zilber Pink for variations of Hodge structures. We prove function field versions of the Zilber Pink conjectures for varieties supporting a variation of Hodge structures. A form of these results for Shimura varieties in the context of unlikely intersections is the following. Let S be a connected pure Shimura variety with a fixed quasiprojective embedding. We show that there is an explicitly computable function B of two natural number arguments so that for any field extension K of the complex numbers and Hodge generic irreducible proper subvariety X subsetneq S K , the set of nonconstant points in the intersection of X with the union of all special subvarieties of X of dimension less than the codimension of X in S is contained in a proper subvariety of X of degree bounded by B( operatorname deg (X), dim(X)) . Our techniques are differential algebraic and rely on Ax Schanuel functional transcendence theorems. We use these results to show that the differential equations associated with Shimura varieties give new examples of minimal, and sometimes, strongly minimal, types with trivial forking geometry but non aleph 0 categorical induced structure.


Rendezvous on the Line with Different Speeds and Markers that can be Dropped at Chosen Time. In this paper we introduce a Linear Program (LP) based formulation of a Rendezvous game with markers on the infinite line and solve it. In this game one player moves at unit speed while the second player moves at a speed bounded by vmax smaller than 1. We observe that in this setting a slow moving player may have interest to rest still instead of moving. This shows that in some conditions the wait for mummy strategy is optimal. We observe as well that the strategies are completely different if the player that holds the marker is the fast or slow one. Interestingly, the marker is not useful when the player without marker moves slowly, i.e. the fast moving player holds the marker.


Asymmetric scattering of mirror symmetric radiation from nanostructures coupled to chiral films. The interaction of radiation with chiral molecular films is not macroscopically invariant under mirror reflections and, accordingly, chiroptical effects exist which affect the spatial symmetry of the radiation profile and which nearly exclusively show up in the near field due to the large molecule wavelength size mismatch. Here we prove that the scattering of a mirror symmetric pair of plane waves by a nanowire lying on a chiral nanofilm is not mirror symmetric with an angular dissymmetry factor that can be as large as some tenths. Due to evanescent coupling, the nanowire efficiently experiences molecular chirality which produces a spatially asymmetric near field so that the self consistent unbalanced excitation of nanowire photonic modes with opposite angular momenta yields asymmetric far field interference. In addition to enriching the physical understaning of mirror symmetry breaking in chiral nanophotonics, our results could suggest ultra efficient schemes for enantiomeric discrimination which is essential in biological chemistry and pharmacology.


Characterizing Intersectional Group Fairness with Worst Case Comparisons. Machine Learning or Artificial Intelligence algorithms have gained considerable scrutiny in recent times owing to their propensity towards imitating and amplifying existing prejudices in society. This has led to a niche but growing body of work that identifies and attempts to fix these biases. A first step towards making these algorithms more fair is designing metrics that measure unfairness. Most existing work in this field deals with either a binary view of fairness (protected vs. unprotected groups) or politically defined categories (race or gender). Such categorization misses the important nuance of intersectionality biases can often be amplified in subgroups that combine membership from different categories, especially if such a subgroup is particularly underrepresented in historical platforms of opportunity. In this paper, we discuss why fairness metrics need to be looked at under the lens of intersectionality, identify existing work in intersectional fairness, suggest a simple worst case comparison method to expand the definitions of existing group fairness metrics to incorporate intersectionality, and finally conclude with the social, legal and political framework to handle intersectional fairness in the modern context.


A novel kinetic mechanism for the onset of fast magnetic reconnection and plasmoid instabilities in collisionless plasmas. Magnetic reconnection can explosively release magnetic energy when opposing magnetic fields merge and annihilate through a current sheet, driving plasma jets and accelerating non thermal particle populations to high energy, in plasmas ranging from space and astrophysical to laboratory scales. Through laboratory experiments and spacecraft observations, significant experimental progress has been made in demonstrating how fast dissipation and reconnection occurs in narrow, kinetic scale current sheets. However, a challenge has been to demonstrate what triggers reconnection and how it proceeds rapidly and efficiently as part of a global system much larger than these kinetic scales. Here we show experimentally the full development of a process where the current sheet forms and then breaks up into multiple current carrying structures at the ion kinetic scale. The results are consistent with tearing of the current sheet, however modified by collisionless kinetic ion effects, which leads to a larger growth rate and number of plasmoids than observed in previous experiments or compared to predictions from standard tearing instability theory and previous non linear kinetic reconnection simulations. This effect will increase the role of plasmoid instabilities in many natural reconnection systems and should be considered in triggering rapid reconnection in a broad range of natural plasmas with collisionless, compressible flows, including at the Earth's magnetosheath and magnetotail and at the heliopause, in accretion disks, and in turbulent high Mach number collisionless shocks.


Enhancing Underwater Image via Adaptive Color and Contrast Enhancement, and Denoising. Images captured underwater are often characterized by low contrast, color distortion, and noise. To address these visual degradations, we propose a novel scheme by constructing an adaptive color and contrast enhancement, and denoising (ACCE D) framework for underwater image enhancement. In the proposed framework, Difference of Gaussian (DoG) filter and bilateral filter are respectively employed to decompose the high frequency and low frequency components. Benefited from this separation, we utilize soft thresholding operation to suppress the noise in the high frequency component. Specially, the low frequency component is enhanced by using an adaptive color and contrast enhancement (ACCE) strategy. The proposed ACCE is an adaptive variational framework implemented in the HSI color space, which integrates data term and regularized term, as well as introduces Gaussian weight and Heaviside function to avoid over enhancement and oversaturation. Moreover, we derive a numerical solution for ACCE, and adopt a pyramid based strategy to accelerate the solving procedure. Experimental results demonstrate that our strategy is effective in color correction, visibility improvement, and detail revealing. Comparison with state of the art techniques also validate the superiority of proposed method. Furthermore, we have verified the utility of our proposed ACCE D for enhancing other types of degraded scenes, including foggy scene, sandstorm scene and low light scene.


Object Disparity. Most of stereo vision works are focusing on computing the dense pixel disparity of a given pair of left and right images. A camera pair usually required lens undistortion and stereo calibration to provide an undistorted epipolar line calibrated image pair for accurate dense pixel disparity computation. Due to noise, object occlusion, repetitive or lack of texture and limitation of matching algorithms, the pixel disparity accuracy usually suffers the most at those object boundary areas. Although statistically the total number of pixel disparity errors might be low (under 2 according to the Kitti Vision Benchmark of current top ranking algorithms), the percentage of these disparity errors at object boundaries are very high. This renders the subsequence 3D object distance detection with much lower accuracy than desired. This paper proposed a different approach for solving a 3D object distance detection by detecting object disparity directly without going through a dense pixel disparity computation. An example squeezenet Object Disparity SSD (OD SSD) was constructed to demonstrate an efficient object disparity detection with comparable accuracy compared with Kitti dataset pixel disparity ground truth. Further training and testing results with mixed image dataset captured by several different stereo systems may suggest that an OD SSD might be agnostic to stereo system parameters such as a baseline, FOV, lens distortion, even left right camera epipolar line misalignment.


Matroids with different configurations and the same mathcal G invariant. From the configuration of a matroid (which records the size and rank of the cyclic flats and the containments among them, but not the sets), one can compute several much studied matroid invariants, including the Tutte polynomial and a newer, stronger invariant, the mathcal G invariant. To gauge how much additional information the configuration contains compared to these invariants, it is of interest to have methods for constructing matroids with different configurations but the same mathcal G invariant. We offer several such constructions along with tools for developing more.


Trace formulation for photonic inverse design with incoherent sources. Spatially incoherent light sources, such as spontaneously emitting atoms, naively require Maxwell's equations to be solved many times to obtain the total emission, which becomes computationally intractable in conjunction with large scale optimization (inverse design). We present a trace formulation of incoherent emission that can be efficiently combined with inverse design, even for topology optimization over thousands of design degrees of freedom. Our formulation includes previous reciprocity based approaches, limited to a few output channels (e.g. normal emission), as special cases, but generalizes to a continuum of emission directions by exploiting the low rank structure of emission problems. We present several examples of incoherent emission topology optimization, including tailoring the geometry of fluorescent particles, a periodically emitting surface, and a structure emitting into a waveguide mode, as well as discussing future applications to problems such as Raman sensing and cathodoluminescence.